logd[6913]: 2007/09/19_14:11:37 info: logd started with /etc/logd.cf. logd[6917]: 2007/09/19_14:11:37 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[6913]: 2007/09/19_14:11:37 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[6934]: 2007/09/19_14:11:37 info: No log entry found in ha.cf -- use logd heartbeat[6934]: 2007/09/19_14:11:37 info: Enabling logging daemon heartbeat[6934]: 2007/09/19_14:11:37 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[6934]: 2007/09/19_14:11:37 info: ************************** heartbeat[6934]: 2007/09/19_14:11:37 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[6935]: 2007/09/19_14:11:37 info: heartbeat: version 2.1.2 heartbeat[6935]: 2007/09/19_14:11:37 info: Heartbeat generation: 1188360838 heartbeat[6935]: 2007/09/19_14:11:37 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[6935]: 2007/09/19_14:11:37 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[6935]: 2007/09/19_14:11:37 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[6935]: 2007/09/19_14:11:37 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[6935]: 2007/09/19_14:11:37 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[6935]: 2007/09/19_14:11:37 info: glib: ping group heartbeat started. heartbeat[6935]: 2007/09/19_14:11:37 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[6935]: 2007/09/19_14:11:38 info: Local status now set to: 'up' heartbeat[6935]: 2007/09/19_14:11:39 info: Link local:local up. heartbeat[6935]: 2007/09/19_14:11:39 info: Status update for node local: status ping heartbeat[6935]: 2007/09/19_14:11:39 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[6935]: 2007/09/19_14:13:38 WARN: node host-2.awale.qc.ca: is dead heartbeat[6935]: 2007/09/19_14:13:38 info: Comm_now_up(): updating status to active heartbeat[6935]: 2007/09/19_14:13:38 info: Local status now set to: 'active' heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[6967]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 6967) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[6935]: 2007/09/19_14:13:38 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[6966]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 6966) heartbeat[6968]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 6968) heartbeat[6969]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 6969) heartbeat[6970]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 6970) cibmon[6966]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[6971]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 6971) heartbeat[6972]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 6972) heartbeat[6973]: 2007/09/19_14:13:38 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 6973) ccm[6967]: 2007/09/19_14:13:38 info: Hostname: host-1.awale.qc.ca cib[6968]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[6970]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[6970]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[6968]: 2007/09/19_14:13:38 info: G_main_add_TriggerHandler: Added signal manual handler cib[6968]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[6968]: 2007/09/19_14:13:38 info: main: Retrieval of a per-action CIB: disabled cib[6968]: 2007/09/19_14:13:38 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[6968]: 2007/09/19_14:13:38 ERROR: validate_cib_digest: Digest comparision failed: aa4cd85366c1b9982c2cf03340feedbe vs. 299c0823dc6c3675aa018aec6ccbf765 cib[6968]: 2007/09/19_14:13:38 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[6968]: 2007/09/19_14:13:38 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. cib[6968]: 2007/09/19_14:13:38 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.6968 cib[6968]: 2007/09/19_14:13:38 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.6968 cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[6968]: 2007/09/19_14:13:38 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[6968]: 2007/09/19_14:13:38 ERROR: validate_cib_digest: Digest comparision failed: aa4cd85366c1b9982c2cf03340feedbe vs. 299c0823dc6c3675aa018aec6ccbf765 cib[6968]: 2007/09/19_14:13:38 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml.last failed! Configuration contents ignored! cib[6968]: 2007/09/19_14:13:38 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml.last will NOT used. cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: Continuing with an empty configuration. cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: No value for admin_epoch was specified in the configuration. cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: The reccomended course of action is to shutdown, run crm_verify and fix any errors it reports. cib[6968]: 2007/09/19_14:13:38 WARN: readCibXmlFile: We will default to zero and continue but may get confused about which configuration to use if multiple nodes are powered up at the same time. cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 info: log_data_element: readCibXmlFile: [on-disk] cib[6968]: 2007/09/19_14:13:38 notice: readCibXmlFile: Enabling DTD validation on the existing (sane) configuration cib[6968]: 2007/09/19_14:13:38 info: startCib: CIB Initialization completed successfully cib[6968]: 2007/09/19_14:13:38 info: cib_register_ha: Signing in with Heartbeat cib[6968]: 2007/09/19_14:13:38 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[6968]: 2007/09/19_14:13:38 WARN: cib_init: CCM Activation failed cib[6968]: 2007/09/19_14:13:38 WARN: cib_init: CCM Connection failed 1 times (30 max) stonithd[6970]: 2007/09/19_14:13:38 info: Signing in with heartbeat. lrmd[6969]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[6969]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[6969]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[6969]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[6969]: 2007/09/19_14:13:38 info: Started. crmd[6972]: 2007/09/19_14:13:38 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[6972]: 2007/09/19_14:13:38 info: crmd_init: Starting crmd crmd[6972]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[6972]: 2007/09/19_14:13:38 info: G_main_add_TriggerHandler: Added signal manual handler crmd[6972]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[6973]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[6973]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[6973]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[6970]: 2007/09/19_14:13:38 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[6970]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[6973]: 2007/09/19_14:13:38 info: init_crm attrd[6971]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[6971]: 2007/09/19_14:13:38 info: register_with_ha: Hostname: host-1.awale.qc.ca ccm[6967]: 2007/09/19_14:13:38 info: Break tie for 2 nodes cluster ccm[6967]: 2007/09/19_14:13:38 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[6971]: 2007/09/19_14:13:38 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[6968]: 2007/09/19_14:13:40 info: cib_init: Starting cib mainloop cib[6968]: 2007/09/19_14:13:40 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[6968]: 2007/09/19_14:13:40 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[6968]: 2007/09/19_14:13:40 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[6966]: 2007/09/19_14:13:40 info: main: Starting mainloop cib[6968]: 2007/09/19_14:13:40 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[6974]: 2007/09/19_14:13:40 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: eee1ed94bfda0ba870b402b24cc9ed13) crmd[6972]: 2007/09/19_14:13:40 info: do_cib_control: CIB connection established cib[6968]: 2007/09/19_14:13:40 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] crmd[6972]: 2007/09/19_14:13:40 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[6968]: 2007/09/19_14:13:40 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[6968]: 2007/09/19_14:13:40 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[6968]: 2007/09/19_14:13:40 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on crmd[6972]: 2007/09/19_14:13:40 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[6972]: 2007/09/19_14:13:40 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[6973]: 2007/09/19_14:13:40 info: Started. crmd[6972]: 2007/09/19_14:13:41 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[6972]: 2007/09/19_14:13:41 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[6972]: 2007/09/19_14:13:41 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[6972]: 2007/09/19_14:13:41 info: do_ha_control: Connected to Heartbeat crmd[6972]: 2007/09/19_14:13:41 info: do_ccm_control: CCM connection established... waiting for first callback crmd[6972]: 2007/09/19_14:13:41 info: do_started: Delaying start, CCM (0000000000100000) not connected cibmon[6966]: 2007/09/19_14:13:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:13:41 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:41 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:13:42 info: crmd_init: Starting crmd's mainloop crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[6972]: 2007/09/19_14:13:42 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[6972]: 2007/09/19_14:13:42 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cib[6975]: 2007/09/19_14:13:42 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: c51a4224f8051ecd91fd9ca4e5c13848) crmd[6972]: 2007/09/19_14:13:42 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[6966]: 2007/09/19_14:13:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:13:42 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:13:42 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[6972]: 2007/09/19_14:13:42 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[6972]: 2007/09/19_14:13:42 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[6972]: 2007/09/19_14:13:42 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[6972]: 2007/09/19_14:13:42 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[6972]: 2007/09/19_14:13:42 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[6972]: 2007/09/19_14:13:42 info: do_started: The local CRM is operational crmd[6972]: 2007/09/19_14:13:42 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[6972]: 2007/09/19_14:13:42 info: update_dc: Set DC to () cibmon[6966]: 2007/09/19_14:13:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:13:42 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:13:42 info: log_data_element: cib_update: + attrd[6971]: 2007/09/19_14:13:45 info: main: Starting mainloop... heartbeat[6935]: 2007/09/19_14:14:08 info: killing /usr/lib/heartbeat/mgmtd -v process group 6973 with signal 15 mgmtd[6973]: 2007/09/19_14:14:08 info: mgmtd is shutting down heartbeat[6935]: 2007/09/19_14:14:08 info: killing /usr/lib/heartbeat/crmd process group 6972 with signal 15 crmd[6972]: 2007/09/19_14:14:08 info: crm_shutdown: Requesting shutdown crmd[6972]: 2007/09/19_14:14:08 info: do_shutdown_req: Sending shutdown request to DC: crmd[6972]: 2007/09/19_14:15:43 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[6972]: 2007/09/19_14:15:43 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[6972]: 2007/09/19_14:15:43 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[6972]: 2007/09/19_14:15:43 info: update_dc: Set DC to () crmd[6972]: 2007/09/19_14:15:43 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[6972]: 2007/09/19_14:15:43 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[6972]: 2007/09/19_14:15:43 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[6972]: 2007/09/19_14:15:43 info: start_subsystem: Starting sub-system "tengine" crmd[6972]: 2007/09/19_14:15:43 info: start_subsystem: Starting sub-system "pengine" crmd[6972]: 2007/09/19_14:15:43 info: do_dc_takeover: Taking over DC status for this partition crmd[6972]: 2007/09/19_14:15:43 info: update_dc: Set DC to () crmd[6972]: 2007/09/19_14:15:43 info: join_make_offer: Making join offers based on membership 1 crmd[6972]: 2007/09/19_14:15:43 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cib[6968]: 2007/09/19_14:15:43 info: cib_process_readwrite: We are now in R/W mode tengine[6994]: 2007/09/19_14:15:43 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[6968]: 2007/09/19_14:15:43 info: revision_check: Updating CIB revision to 1.3 tengine[6994]: 2007/09/19_14:15:43 info: G_main_add_TriggerHandler: Added signal manual handler cibmon[6966]: 2007/09/19_14:15:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:15:43 info: log_cib_diff: cib_update: Diff: --- 0.0.0 cibmon[6966]: 2007/09/19_14:15:43 info: log_cib_diff: cib_update: Diff: +++ 0.0.1 cibmon[6966]: 2007/09/19_14:15:43 info: log_data_element: cib_update: - cibmon[6966]: 2007/09/19_14:15:43 info: log_data_element: cib_update: + cib[6968]: 2007/09/19_14:15:43 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[6994]: 2007/09/19_14:15:43 info: te_init: Registering TE UUID: 18eeb2a3-3680-4041-a440-040d67b060a4 tengine[6994]: 2007/09/19_14:15:43 info: set_graph_functions: Setting custom graph functions tengine[6994]: 2007/09/19_14:15:43 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[6994]: 2007/09/19_14:15:43 info: te_init: Starting tengine pengine[6995]: 2007/09/19_14:15:43 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[6995]: 2007/09/19_14:15:43 info: pe_init: Starting pengine crmd[6972]: 2007/09/19_14:15:43 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] cib[6968]: 2007/09/19_14:15:44 info: sync_our_cib: Syncing CIB to all peers crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[6972]: 2007/09/19_14:15:44 info: update_attrd: Connecting to attrd... attrd[6971]: 2007/09/19_14:15:44 info: attrd_local_callback: Sending full refresh cibmon[6966]: 2007/09/19_14:15:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: --- 0.0.1 cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: +++ 0.0.2 cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: --- 0.0.2 cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: +++ 0.0.3 cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:15:44 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[6972]: 2007/09/19_14:15:44 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[6966]: 2007/09/19_14:15:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: --- 0.0.3 crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: +++ 0.0.4 cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + tengine[6994]: 2007/09/19_14:15:44 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[6994]: 2007/09/19_14:15:44 info: update_abort_priority: 'DC Takeover' abort superceeded pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[6994]: 2007/09/19_14:15:44 info: unpack_graph: Unpacked transition 0: 1 actions in 1 synapses pengine[6995]: 2007/09/19_14:15:44 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[6994]: 2007/09/19_14:15:44 info: send_rsc_command: Initiating action 2: probe_complete on host-1.awale.qc.ca pengine[6995]: 2007/09/19_14:15:44 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-23.bz2 tengine[6994]: 2007/09/19_14:15:44 info: run_graph: Transition 0: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[6994]: 2007/09/19_14:15:44 info: notify_crmd: Transition 0 status: te_complete - crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown_req: Processing shutdown locally crmd[6972]: 2007/09/19_14:15:44 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[6994]: 2007/09/19_14:15:44 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[6994]: 2007/09/19_14:15:44 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[6966]: 2007/09/19_14:15:44 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[6994]: 2007/09/19_14:15:44 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_modify: Diff: --- 0.0.4 pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_modify: Diff: +++ 0.0.5 pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: - pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_modify: + pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[6966]: 2007/09/19_14:15:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6995]: 2007/09/19_14:15:44 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: --- 0.0.5 pengine[6995]: 2007/09/19_14:15:44 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[6966]: 2007/09/19_14:15:44 info: log_cib_diff: cib_update: Diff: +++ 0.0.6 tengine[6994]: 2007/09/19_14:15:44 info: unpack_graph: Unpacked transition 2: 1 actions in 1 synapses pengine[6995]: 2007/09/19_14:15:44 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-24.bz2 cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - tengine[6994]: 2007/09/19_14:15:44 info: te_crm_command: Executing crm-event (3): do_shutdown on host-1.awale.qc.ca pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - crmd[6972]: 2007/09/19_14:15:44 info: handle_request: Shutting ourselves down (DC) tengine[6994]: 2007/09/19_14:15:44 info: te_crm_command: Skipping wait for 3 pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ] tengine[6994]: 2007/09/19_14:15:44 info: run_graph: Transition 2: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - crmd[6972]: 2007/09/19_14:15:44 info: do_dc_release: DC role released tengine[6994]: 2007/09/19_14:15:44 info: notify_crmd: Transition 2 status: te_complete - pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: - crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] tengine[6994]: 2007/09/19_14:15:44 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to tengine: [6994] tengine[6994]: 2007/09/19_14:15:44 info: update_abort_priority: Abort action 2 superceeded by 3 pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the pengine tengine[6994]: 2007/09/19_14:15:44 info: notify_crmd: Exiting after transition pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] tengine[6994]: 2007/09/19_14:15:44 info: te_init: Exiting tengine pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the tengine pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' cibmon[6966]: 2007/09/19_14:15:44 info: log_data_element: cib_update: + ccm[6967]: 2007/09/19_14:15:44 info: client (pid=6972) removed from ccm crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to tengine: [6994] pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' cib[6968]: 2007/09/19_14:15:44 info: cib_process_readwrite: We are now in R/O mode crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Waiting for subsystems to exit pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[6972]: 2007/09/19_14:15:44 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[6972]: 2007/09/19_14:15:44 WARN: do_log: [[FSA]] Input I_TE_SUCCESS from route_message() received in state (S_STOPPING) pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the pengine pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the tengine pengine[6995]: 2007/09/19_14:15:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to tengine: [6994] pengine[6995]: 2007/09/19_14:15:44 info: determine_online_status: Node host-1.awale.qc.ca is shutting down crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Waiting for subsystems to exit pengine[6995]: 2007/09/19_14:15:44 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown crmd[6972]: 2007/09/19_14:15:44 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs pengine[6995]: 2007/09/19_14:15:44 info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-25.bz2 crmd[6972]: 2007/09/19_14:15:44 info: crmdManagedChildDied: Process tengine:[6994] exited (signal=0, exitcode=0) pengine[6995]: 2007/09/19_14:15:44 info: pengine_shutdown: Exiting PEngine (SIGTERM) crmd[6972]: 2007/09/19_14:15:44 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the pengine crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Waiting for subsystems to exit crmd[6972]: 2007/09/19_14:15:44 info: process_client_disconnect: Received HUP from tengine:[-1] crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the pengine crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Waiting for subsystems to exit crmd[6972]: 2007/09/19_14:15:44 info: process_client_disconnect: Received HUP from pengine:[6995] heartbeat[6935]: 2007/09/19_14:15:44 info: killing /usr/lib/heartbeat/attrd process group 6971 with signal 15 crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Terminating the pengine crmd[6972]: 2007/09/19_14:15:44 info: stop_subsystem: Sent -TERM to pengine: [6995] attrd[6971]: 2007/09/19_14:15:44 info: attrd_shutdown: Exiting crmd[6972]: 2007/09/19_14:15:44 info: do_shutdown: Waiting for subsystems to exit crmd[6972]: 2007/09/19_14:15:44 info: crmdManagedChildDied: Process pengine:[6995] exited (signal=0, exitcode=0) attrd[6971]: 2007/09/19_14:15:44 info: main: Exiting... crmd[6972]: 2007/09/19_14:15:44 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[6972]: 2007/09/19_14:15:44 info: verify_stopped: Checking for active resources before exit crmd[6972]: 2007/09/19_14:15:44 info: verify_stopped: Checking for active resources before exit heartbeat[6935]: 2007/09/19_14:15:44 info: killing /usr/lib/heartbeat/stonithd process group 6970 with signal 15 crmd[6972]: 2007/09/19_14:15:44 info: do_lrm_control: Disconnected from the LRM crmd[6972]: 2007/09/19_14:15:44 info: do_ha_control: Disconnected from Heartbeat crmd[6972]: 2007/09/19_14:15:44 info: do_cib_control: Disconnecting CIB crmd[6972]: 2007/09/19_14:15:44 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[6972]: 2007/09/19_14:15:44 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd stonithd[6970]: 2007/09/19_14:15:44 notice: /usr/lib/heartbeat/stonithd normally quit. crmd[6972]: 2007/09/19_14:15:44 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[6972]: 2007/09/19_14:15:44 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[6972]: 2007/09/19_14:15:44 info: do_exit: [crmd] stopped (0) heartbeat[6935]: 2007/09/19_14:15:44 info: killing /usr/lib/heartbeat/lrmd -r process group 6969 with signal 15 lrmd[6969]: 2007/09/19_14:15:44 info: lrmd is shutting down heartbeat[6935]: 2007/09/19_14:15:44 info: killing /usr/lib/heartbeat/cib process group 6968 with signal 15 cib[6968]: 2007/09/19_14:15:44 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[6968]: 2007/09/19_14:15:44 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[6966]: 2007/09/19_14:15:44 ERROR: cib_native_msgready: Message pending on command channel [6968] cib[6968]: 2007/09/19_14:15:44 info: cib_shutdown: Disconnected 2 clients cibmon[6966]: 2007/09/19_14:15:44 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[6968]: 2007/09/19_14:15:44 info: cib_process_disconnect: All clients disconnected... cibmon[6966]: 2007/09/19_14:15:44 ERROR: MSG: No message to dump cib[6968]: 2007/09/19_14:15:44 info: terminate_ha_connection: initiate_exit: Disconnecting heartbeat cibmon[6966]: 2007/09/19_14:15:44 info: cib_native_msgready: Lost connection to the CIB service [6968]. cibmon[6966]: 2007/09/19_14:15:44 CRIT: cib_native_dispatch: Lost connection to the CIB service [6968/callback]. cibmon[6966]: 2007/09/19_14:15:44 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[6968]: 2007/09/19_14:15:44 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[6968]: 2007/09/19_14:15:44 info: main: Done ccm[6967]: 2007/09/19_14:15:44 info: client (pid=6968) removed from ccm heartbeat[6935]: 2007/09/19_14:15:44 info: killing /usr/lib/heartbeat/ccm process group 6967 with signal 15 ccm[6967]: 2007/09/19_14:15:44 info: received SIGTERM, going to shut down heartbeat[6935]: 2007/09/19_14:15:44 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[6935]: 2007/09/19_14:15:45 info: killing HBREAD process 6941 with signal 15 heartbeat[6935]: 2007/09/19_14:15:45 info: killing HBWRITE process 6942 with signal 15 heartbeat[6935]: 2007/09/19_14:15:45 info: killing HBREAD process 6943 with signal 15 heartbeat[6935]: 2007/09/19_14:15:45 info: killing HBFIFO process 6939 with signal 15 heartbeat[6935]: 2007/09/19_14:15:45 info: killing HBWRITE process 6940 with signal 15 heartbeat[6935]: 2007/09/19_14:15:45 info: Core process 6939 exited. 5 remaining heartbeat[6935]: 2007/09/19_14:15:45 info: Core process 6940 exited. 4 remaining heartbeat[6935]: 2007/09/19_14:15:45 info: Core process 6943 exited. 3 remaining heartbeat[6935]: 2007/09/19_14:15:45 info: Core process 6941 exited. 2 remaining heartbeat[6935]: 2007/09/19_14:15:45 info: Core process 6942 exited. 1 remaining heartbeat[6935]: 2007/09/19_14:15:45 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[6917]: 2007/09/19_14:15:46 info: logd_term_write_action: received SIGTERM logd[6917]: 2007/09/19_14:15:46 info: Exiting write process logd[7039]: 2007/09/19_14:17:56 info: logd started with /etc/logd.cf. logd[7044]: 2007/09/19_14:17:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[7039]: 2007/09/19_14:17:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7060]: 2007/09/19_14:17:56 info: No log entry found in ha.cf -- use logd heartbeat[7060]: 2007/09/19_14:17:56 info: Enabling logging daemon heartbeat[7060]: 2007/09/19_14:17:56 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[7060]: 2007/09/19_14:17:56 info: ************************** heartbeat[7060]: 2007/09/19_14:17:56 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[7061]: 2007/09/19_14:17:56 info: heartbeat: version 2.1.2 heartbeat[7061]: 2007/09/19_14:17:56 info: Heartbeat generation: 1188360839 heartbeat[7061]: 2007/09/19_14:17:56 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7061]: 2007/09/19_14:17:56 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7061]: 2007/09/19_14:17:56 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[7061]: 2007/09/19_14:17:56 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[7061]: 2007/09/19_14:17:56 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[7061]: 2007/09/19_14:17:56 info: glib: ping group heartbeat started. heartbeat[7061]: 2007/09/19_14:17:56 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[7061]: 2007/09/19_14:17:56 info: Local status now set to: 'up' heartbeat[7061]: 2007/09/19_14:17:58 info: Link local:local up. heartbeat[7061]: 2007/09/19_14:17:58 info: Status update for node local: status ping heartbeat[7061]: 2007/09/19_14:17:58 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[7061]: 2007/09/19_14:19:56 WARN: node host-2.awale.qc.ca: is dead heartbeat[7061]: 2007/09/19_14:19:56 info: Comm_now_up(): updating status to active heartbeat[7061]: 2007/09/19_14:19:56 info: Local status now set to: 'active' heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[7073]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 7073) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[7061]: 2007/09/19_14:19:56 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[7074]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 7074) heartbeat[7076]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 7076) heartbeat[7077]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 7077) heartbeat[7078]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 7078) heartbeat[7080]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 7080) cibmon[7073]: 2007/09/19_14:19:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7075]: 2007/09/19_14:19:56 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 7075) heartbeat[7079]: 2007/09/19_14:19:57 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 7079) cib[7075]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7075]: 2007/09/19_14:19:57 info: G_main_add_TriggerHandler: Added signal manual handler cib[7075]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7075]: 2007/09/19_14:19:57 info: main: Retrieval of a per-action CIB: disabled cib[7075]: 2007/09/19_14:19:57 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[7075]: 2007/09/19_14:19:57 ERROR: validate_cib_digest: Digest comparision failed: c51a4224f8051ecd91fd9ca4e5c13848 vs. 8e5a99e19a9a78ab43be130856802e77 cib[7075]: 2007/09/19_14:19:57 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[7075]: 2007/09/19_14:19:57 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. crmd[7079]: 2007/09/19_14:19:57 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[7079]: 2007/09/19_14:19:57 info: crmd_init: Starting crmd crmd[7079]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[7079]: 2007/09/19_14:19:57 info: G_main_add_TriggerHandler: Added signal manual handler crmd[7079]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7075]: 2007/09/19_14:19:57 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.7075 cib[7075]: 2007/09/19_14:19:57 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.7075 cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[7075]: 2007/09/19_14:19:57 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[7075]: 2007/09/19_14:19:57 ERROR: validate_cib_digest: Digest comparision failed: c51a4224f8051ecd91fd9ca4e5c13848 vs. 8e5a99e19a9a78ab43be130856802e77 cib[7075]: 2007/09/19_14:19:57 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml.last failed! Configuration contents ignored! cib[7075]: 2007/09/19_14:19:57 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml.last will NOT used. cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: Continuing with an empty configuration. cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: No value for admin_epoch was specified in the configuration. cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: The reccomended course of action is to shutdown, run crm_verify and fix any errors it reports. cib[7075]: 2007/09/19_14:19:57 WARN: readCibXmlFile: We will default to zero and continue but may get confused about which configuration to use if multiple nodes are powered up at the same time. cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] ccm[7074]: 2007/09/19_14:19:57 info: Hostname: host-1.awale.qc.ca lrmd[7076]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[7076]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[7076]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[7076]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[7076]: 2007/09/19_14:19:57 info: Started. cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 info: log_data_element: readCibXmlFile: [on-disk] cib[7075]: 2007/09/19_14:19:57 notice: readCibXmlFile: Enabling DTD validation on the existing (sane) configuration stonithd[7077]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[7077]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[7075]: 2007/09/19_14:19:57 info: startCib: CIB Initialization completed successfully cib[7075]: 2007/09/19_14:19:57 info: cib_register_ha: Signing in with Heartbeat cib[7075]: 2007/09/19_14:19:57 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[7075]: 2007/09/19_14:19:57 WARN: cib_init: CCM Activation failed cib[7075]: 2007/09/19_14:19:57 WARN: cib_init: CCM Connection failed 1 times (30 max) mgmtd[7080]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[7080]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[7080]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[7080]: 2007/09/19_14:19:57 info: init_crm stonithd[7077]: 2007/09/19_14:19:57 info: Signing in with heartbeat. attrd[7078]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[7077]: 2007/09/19_14:19:57 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[7077]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[7078]: 2007/09/19_14:19:57 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[7078]: 2007/09/19_14:19:57 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 ccm[7074]: 2007/09/19_14:19:57 info: Break tie for 2 nodes cluster ccm[7074]: 2007/09/19_14:19:57 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7075]: 2007/09/19_14:19:58 info: cib_init: Starting cib mainloop cib[7075]: 2007/09/19_14:19:58 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[7075]: 2007/09/19_14:19:58 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[7075]: 2007/09/19_14:19:58 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[7073]: 2007/09/19_14:19:58 info: main: Starting mainloop cib[7075]: 2007/09/19_14:19:58 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[7079]: 2007/09/19_14:19:58 info: do_cib_control: CIB connection established cib[7075]: 2007/09/19_14:19:58 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[7075]: 2007/09/19_14:19:58 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[7075]: 2007/09/19_14:19:58 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] crmd[7079]: 2007/09/19_14:19:58 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[7075]: 2007/09/19_14:19:58 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[7081]: 2007/09/19_14:19:58 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 6fb3d2693a284a94a6c67b365a19b83a) crmd[7079]: 2007/09/19_14:19:58 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[7079]: 2007/09/19_14:19:59 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[7080]: 2007/09/19_14:19:59 info: Started. crmd[7079]: 2007/09/19_14:20:00 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[7079]: 2007/09/19_14:20:00 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[7079]: 2007/09/19_14:20:00 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[7079]: 2007/09/19_14:20:00 info: do_ha_control: Connected to Heartbeat crmd[7079]: 2007/09/19_14:20:00 info: do_ccm_control: CCM connection established... waiting for first callback cibmon[7073]: 2007/09/19_14:20:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[7079]: 2007/09/19_14:20:00 info: do_started: Delaying start, CCM (0000000000100000) not connected cibmon[7073]: 2007/09/19_14:20:00 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 crmd[7079]: 2007/09/19_14:20:00 info: crmd_init: Starting crmd's mainloop cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + crmd[7079]: 2007/09/19_14:20:00 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cib[7082]: 2007/09/19_14:20:00 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 5bae2928cf17863dd3a95465cb7acea1) crmd[7079]: 2007/09/19_14:20:00 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[7073]: 2007/09/19_14:20:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7073]: 2007/09/19_14:20:00 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:00 info: log_data_element: cib_update: + crmd[7079]: 2007/09/19_14:20:01 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[7079]: 2007/09/19_14:20:01 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[7079]: 2007/09/19_14:20:01 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[7079]: 2007/09/19_14:20:01 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[7079]: 2007/09/19_14:20:01 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[7079]: 2007/09/19_14:20:01 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[7079]: 2007/09/19_14:20:01 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7079]: 2007/09/19_14:20:01 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7079]: 2007/09/19_14:20:01 info: do_started: The local CRM is operational cibmon[7073]: 2007/09/19_14:20:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[7079]: 2007/09/19_14:20:01 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] cibmon[7073]: 2007/09/19_14:20:01 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 crmd[7079]: 2007/09/19_14:20:01 info: update_dc: Set DC to () cibmon[7073]: 2007/09/19_14:20:01 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:01 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:01 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:01 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:20:01 info: log_data_element: cib_update: + attrd[7078]: 2007/09/19_14:20:03 info: main: Starting mainloop... heartbeat[7061]: 2007/09/19_14:20:23 info: killing /usr/lib/heartbeat/mgmtd -v process group 7080 with signal 15 mgmtd[7080]: 2007/09/19_14:20:23 info: mgmtd is shutting down heartbeat[7061]: 2007/09/19_14:20:23 info: killing /usr/lib/heartbeat/crmd process group 7079 with signal 15 crmd[7079]: 2007/09/19_14:20:23 info: crm_shutdown: Requesting shutdown crmd[7079]: 2007/09/19_14:20:23 info: do_shutdown_req: Sending shutdown request to DC: crmd[7079]: 2007/09/19_14:22:02 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[7079]: 2007/09/19_14:22:02 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[7079]: 2007/09/19_14:22:02 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[7079]: 2007/09/19_14:22:02 info: update_dc: Set DC to () crmd[7079]: 2007/09/19_14:22:02 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[7079]: 2007/09/19_14:22:02 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[7079]: 2007/09/19_14:22:02 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[7079]: 2007/09/19_14:22:02 info: start_subsystem: Starting sub-system "tengine" crmd[7079]: 2007/09/19_14:22:02 info: start_subsystem: Starting sub-system "pengine" crmd[7079]: 2007/09/19_14:22:02 info: do_dc_takeover: Taking over DC status for this partition crmd[7079]: 2007/09/19_14:22:02 info: update_dc: Set DC to () crmd[7079]: 2007/09/19_14:22:02 info: join_make_offer: Making join offers based on membership 1 crmd[7079]: 2007/09/19_14:22:02 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cib[7075]: 2007/09/19_14:22:02 info: cib_process_readwrite: We are now in R/W mode cib[7075]: 2007/09/19_14:22:02 info: revision_check: Updating CIB revision to 1.3 cibmon[7073]: 2007/09/19_14:22:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7073]: 2007/09/19_14:22:02 info: log_cib_diff: cib_update: Diff: --- 0.0.0 cibmon[7073]: 2007/09/19_14:22:02 info: log_cib_diff: cib_update: Diff: +++ 0.0.1 cibmon[7073]: 2007/09/19_14:22:02 info: log_data_element: cib_update: - cibmon[7073]: 2007/09/19_14:22:02 info: log_data_element: cib_update: + tengine[7102]: 2007/09/19_14:22:02 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[7102]: 2007/09/19_14:22:02 info: G_main_add_TriggerHandler: Added signal manual handler cib[7075]: 2007/09/19_14:22:02 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[7102]: 2007/09/19_14:22:02 info: te_init: Registering TE UUID: 2129cce3-0fa7-4be4-8b57-fea6c5908be8 tengine[7102]: 2007/09/19_14:22:02 info: set_graph_functions: Setting custom graph functions tengine[7102]: 2007/09/19_14:22:02 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[7102]: 2007/09/19_14:22:02 info: te_init: Starting tengine pengine[7103]: 2007/09/19_14:22:02 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[7103]: 2007/09/19_14:22:02 info: pe_init: Starting pengine crmd[7079]: 2007/09/19_14:22:02 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: All 1 cluster nodes responded to the join offer. attrd[7078]: 2007/09/19_14:22:03 info: attrd_local_callback: Sending full refresh crmd[7079]: 2007/09/19_14:22:03 info: update_attrd: Connecting to attrd... cib[7075]: 2007/09/19_14:22:03 info: sync_our_cib: Syncing CIB to all peers cibmon[7073]: 2007/09/19_14:22:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: --- 0.0.1 cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: +++ 0.0.2 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: --- 0.0.2 cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: +++ 0.0.3 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + crmd[7079]: 2007/09/19_14:22:03 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7079]: 2007/09/19_14:22:03 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[7073]: 2007/09/19_14:22:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: --- 0.0.3 crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[7102]: 2007/09/19_14:22:03 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: +++ 0.0.4 tengine[7102]: 2007/09/19_14:22:03 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' tengine[7102]: 2007/09/19_14:22:03 info: unpack_graph: Unpacked transition 0: 1 actions in 1 synapses pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' tengine[7102]: 2007/09/19_14:22:03 info: send_rsc_command: Initiating action 2: probe_complete on host-1.awale.qc.ca pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' tengine[7102]: 2007/09/19_14:22:03 info: run_graph: Transition 0: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[7102]: 2007/09/19_14:22:03 info: notify_crmd: Transition 0 status: te_complete - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown_req: Processing shutdown locally pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[7079]: 2007/09/19_14:22:03 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[7073]: 2007/09/19_14:22:03 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed pengine[7103]: 2007/09/19_14:22:03 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_modify: Diff: --- 0.0.4 cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_modify: Diff: +++ 0.0.5 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: - cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + tengine[7102]: 2007/09/19_14:22:03 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[7102]: 2007/09/19_14:22:03 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[7102]: 2007/09/19_14:22:03 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + pengine[7103]: 2007/09/19_14:22:03 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-26.bz2 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_modify: + cibmon[7073]: 2007/09/19_14:22:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: --- 0.0.5 cibmon[7073]: 2007/09/19_14:22:03 info: log_cib_diff: cib_update: Diff: +++ 0.0.6 cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[7073]: 2007/09/19_14:22:03 info: log_data_element: cib_update: + pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[7102]: 2007/09/19_14:22:03 info: unpack_graph: Unpacked transition 2: 1 actions in 1 synapses pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[7102]: 2007/09/19_14:22:03 info: te_crm_command: Executing crm-event (3): do_shutdown on host-1.awale.qc.ca pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[7079]: 2007/09/19_14:22:03 info: handle_request: Shutting ourselves down (DC) tengine[7102]: 2007/09/19_14:22:03 info: te_crm_command: Skipping wait for 3 pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ] tengine[7102]: 2007/09/19_14:22:03 info: run_graph: Transition 2: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[7079]: 2007/09/19_14:22:03 info: do_dc_release: DC role released tengine[7102]: 2007/09/19_14:22:03 info: notify_crmd: Transition 2 status: te_complete - pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] tengine[7102]: 2007/09/19_14:22:03 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to tengine: [7102] tengine[7102]: 2007/09/19_14:22:03 info: update_abort_priority: Abort action 2 superceeded by 3 pengine[7103]: 2007/09/19_14:22:03 info: determine_online_status: Node host-1.awale.qc.ca is shutting down crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the pengine tengine[7102]: 2007/09/19_14:22:03 info: notify_crmd: Exiting after transition pengine[7103]: 2007/09/19_14:22:03 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] tengine[7102]: 2007/09/19_14:22:03 info: te_init: Exiting tengine pengine[7103]: 2007/09/19_14:22:03 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-27.bz2 crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the tengine pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to tengine: [7102] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Waiting for subsystems to exit pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' crmd[7079]: 2007/09/19_14:22:03 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' crmd[7079]: 2007/09/19_14:22:03 WARN: do_log: [[FSA]] Input I_TE_SUCCESS from route_message() received in state (S_STOPPING) pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the pengine pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the tengine pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to tengine: [7102] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Waiting for subsystems to exit pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[7079]: 2007/09/19_14:22:03 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[7079]: 2007/09/19_14:22:03 info: crmdManagedChildDied: Process tengine:[7102] exited (signal=0, exitcode=0) pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[7079]: 2007/09/19_14:22:03 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the pengine pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Waiting for subsystems to exit pengine[7103]: 2007/09/19_14:22:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[7079]: 2007/09/19_14:22:03 info: process_client_disconnect: Received HUP from tengine:[-1] pengine[7103]: 2007/09/19_14:22:03 info: determine_online_status: Node host-1.awale.qc.ca is shutting down crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the pengine pengine[7103]: 2007/09/19_14:22:03 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Waiting for subsystems to exit pengine[7103]: 2007/09/19_14:22:03 info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-28.bz2 pengine[7103]: 2007/09/19_14:22:03 info: pengine_shutdown: Exiting PEngine (SIGTERM) crmd[7079]: 2007/09/19_14:22:03 info: process_client_disconnect: Received HUP from pengine:[7103] crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Terminating the pengine ccm[7074]: 2007/09/19_14:22:03 info: client (pid=7079) removed from ccm crmd[7079]: 2007/09/19_14:22:03 info: stop_subsystem: Sent -TERM to pengine: [7103] crmd[7079]: 2007/09/19_14:22:03 info: do_shutdown: Waiting for subsystems to exit cib[7075]: 2007/09/19_14:22:03 info: cib_process_readwrite: We are now in R/O mode crmd[7079]: 2007/09/19_14:22:03 info: crmdManagedChildDied: Process pengine:[7103] exited (signal=0, exitcode=0) crmd[7079]: 2007/09/19_14:22:03 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[7079]: 2007/09/19_14:22:03 info: verify_stopped: Checking for active resources before exit crmd[7079]: 2007/09/19_14:22:03 info: verify_stopped: Checking for active resources before exit crmd[7079]: 2007/09/19_14:22:03 info: do_lrm_control: Disconnected from the LRM crmd[7079]: 2007/09/19_14:22:03 info: do_ha_control: Disconnected from Heartbeat crmd[7079]: 2007/09/19_14:22:03 info: do_cib_control: Disconnecting CIB crmd[7079]: 2007/09/19_14:22:03 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[7079]: 2007/09/19_14:22:03 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[7079]: 2007/09/19_14:22:03 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[7079]: 2007/09/19_14:22:03 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[7079]: 2007/09/19_14:22:03 info: do_exit: [crmd] stopped (0) heartbeat[7061]: 2007/09/19_14:22:03 info: killing /usr/lib/heartbeat/attrd process group 7078 with signal 15 attrd[7078]: 2007/09/19_14:22:03 info: attrd_shutdown: Exiting attrd[7078]: 2007/09/19_14:22:03 info: main: Exiting... heartbeat[7061]: 2007/09/19_14:22:03 info: killing /usr/lib/heartbeat/stonithd process group 7077 with signal 15 stonithd[7077]: 2007/09/19_14:22:03 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[7061]: 2007/09/19_14:22:03 info: killing /usr/lib/heartbeat/lrmd -r process group 7076 with signal 15 lrmd[7076]: 2007/09/19_14:22:03 info: lrmd is shutting down heartbeat[7061]: 2007/09/19_14:22:03 info: killing /usr/lib/heartbeat/cib process group 7075 with signal 15 cib[7075]: 2007/09/19_14:22:03 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[7075]: 2007/09/19_14:22:03 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cib[7075]: 2007/09/19_14:22:03 info: cib_shutdown: Disconnected 2 clients cib[7075]: 2007/09/19_14:22:03 info: cib_process_disconnect: All clients disconnected... cib[7075]: 2007/09/19_14:22:03 info: terminate_ha_connection: initiate_exit: Disconnecting heartbeat cibmon[7073]: 2007/09/19_14:22:03 ERROR: cib_native_msgready: Message pending on command channel [7075] cibmon[7073]: 2007/09/19_14:22:03 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cibmon[7073]: 2007/09/19_14:22:03 ERROR: MSG: No message to dump cib[7075]: 2007/09/19_14:22:03 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cibmon[7073]: 2007/09/19_14:22:03 info: cib_native_msgready: Lost connection to the CIB service [7075]. cib[7075]: 2007/09/19_14:22:03 info: main: Done cibmon[7073]: 2007/09/19_14:22:03 CRIT: cib_native_dispatch: Lost connection to the CIB service [7075/callback]. cibmon[7073]: 2007/09/19_14:22:03 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting ccm[7074]: 2007/09/19_14:22:03 info: client (pid=7075) removed from ccm heartbeat[7061]: 2007/09/19_14:22:03 info: killing /usr/lib/heartbeat/ccm process group 7074 with signal 15 ccm[7074]: 2007/09/19_14:22:03 info: received SIGTERM, going to shut down heartbeat[7061]: 2007/09/19_14:22:03 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[7061]: 2007/09/19_14:22:04 info: killing HBFIFO process 7065 with signal 15 heartbeat[7061]: 2007/09/19_14:22:04 info: killing HBWRITE process 7066 with signal 15 heartbeat[7061]: 2007/09/19_14:22:04 info: killing HBREAD process 7067 with signal 15 heartbeat[7061]: 2007/09/19_14:22:04 info: killing HBWRITE process 7068 with signal 15 heartbeat[7061]: 2007/09/19_14:22:04 info: killing HBREAD process 7069 with signal 15 heartbeat[7061]: 2007/09/19_14:22:04 info: Core process 7065 exited. 5 remaining heartbeat[7061]: 2007/09/19_14:22:04 info: Core process 7069 exited. 4 remaining heartbeat[7061]: 2007/09/19_14:22:04 info: Core process 7068 exited. 3 remaining heartbeat[7061]: 2007/09/19_14:22:04 info: Core process 7067 exited. 2 remaining heartbeat[7061]: 2007/09/19_14:22:04 info: Core process 7066 exited. 1 remaining heartbeat[7061]: 2007/09/19_14:22:04 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[7044]: 2007/09/19_14:22:05 info: logd_term_write_action: received SIGTERM logd[7044]: 2007/09/19_14:22:05 info: Exiting write process logd[7158]: 2007/09/19_14:23:43 info: logd started with /etc/logd.cf. logd[7164]: 2007/09/19_14:23:43 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[7158]: 2007/09/19_14:23:43 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7179]: 2007/09/19_14:23:43 info: No log entry found in ha.cf -- use logd heartbeat[7179]: 2007/09/19_14:23:43 info: Enabling logging daemon heartbeat[7179]: 2007/09/19_14:23:43 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[7179]: 2007/09/19_14:23:43 info: ************************** heartbeat[7179]: 2007/09/19_14:23:43 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[7180]: 2007/09/19_14:23:43 info: heartbeat: version 2.1.2 heartbeat[7180]: 2007/09/19_14:23:43 info: Heartbeat generation: 1188360840 heartbeat[7180]: 2007/09/19_14:23:43 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7180]: 2007/09/19_14:23:43 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7180]: 2007/09/19_14:23:43 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[7180]: 2007/09/19_14:23:43 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[7180]: 2007/09/19_14:23:43 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[7180]: 2007/09/19_14:23:43 info: glib: ping group heartbeat started. heartbeat[7180]: 2007/09/19_14:23:43 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[7180]: 2007/09/19_14:23:43 info: Local status now set to: 'up' heartbeat[7180]: 2007/09/19_14:23:45 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[7180]: 2007/09/19_14:23:45 info: Link local:local up. heartbeat[7180]: 2007/09/19_14:23:45 info: Status update for node local: status ping heartbeat[7208]: 2007/09/19_14:24:13 info: No log entry found in ha.cf -- use logd heartbeat[7208]: 2007/09/19_14:24:13 info: Enabling logging daemon heartbeat[7208]: 2007/09/19_14:24:13 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[7208]: 2007/09/19_14:24:13 info: Signalling heartbeat pid 7180 to reread config files heartbeat[7180]: 2007/09/19_14:24:13 info: Configuration unchanged. heartbeat[7180]: 2007/09/19_14:25:44 WARN: node host-2.awale.qc.ca: is dead heartbeat[7180]: 2007/09/19_14:25:44 info: Comm_now_up(): updating status to active heartbeat[7180]: 2007/09/19_14:25:44 info: Local status now set to: 'active' heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[7222]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 7222) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[7180]: 2007/09/19_14:25:44 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[7223]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 7223) heartbeat[7225]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 7225) cibmon[7222]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7226]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 7226) heartbeat[7229]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 7229) heartbeat[7228]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 7228) heartbeat[7227]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 7227) lrmd[7225]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7224]: 2007/09/19_14:25:44 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 7224) lrmd[7225]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[7225]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[7225]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[7225]: 2007/09/19_14:25:44 info: Started. cib[7224]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7224]: 2007/09/19_14:25:44 info: G_main_add_TriggerHandler: Added signal manual handler cib[7224]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7224]: 2007/09/19_14:25:44 info: main: Retrieval of a per-action CIB: disabled cib[7224]: 2007/09/19_14:25:44 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[7224]: 2007/09/19_14:25:44 WARN: validate_cib_digest: No on-disk digest present cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] ccm[7223]: 2007/09/19_14:25:44 info: Hostname: host-1.awale.qc.ca cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] stonithd[7226]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 10 cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] stonithd[7226]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: log_data_element: readCibXmlFile: [on-disk] cib[7224]: 2007/09/19_14:25:44 info: startCib: CIB Initialization completed successfully cib[7224]: 2007/09/19_14:25:44 info: cib_register_ha: Signing in with Heartbeat cib[7224]: 2007/09/19_14:25:44 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[7224]: 2007/09/19_14:25:44 WARN: cib_init: CCM Activation failed cib[7224]: 2007/09/19_14:25:44 WARN: cib_init: CCM Connection failed 1 times (30 max) attrd[7227]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[7227]: 2007/09/19_14:25:44 info: register_with_ha: Hostname: host-1.awale.qc.ca stonithd[7226]: 2007/09/19_14:25:44 info: Signing in with heartbeat. crmd[7228]: 2007/09/19_14:25:44 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[7228]: 2007/09/19_14:25:44 info: crmd_init: Starting crmd crmd[7228]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[7228]: 2007/09/19_14:25:44 info: G_main_add_TriggerHandler: Added signal manual handler crmd[7228]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[7229]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[7229]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[7229]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[7227]: 2007/09/19_14:25:44 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 stonithd[7226]: 2007/09/19_14:25:44 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[7226]: 2007/09/19_14:25:44 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[7229]: 2007/09/19_14:25:44 info: init_crm cib[7224]: 2007/09/19_14:25:45 WARN: cib_init: CCM Activation failed cib[7224]: 2007/09/19_14:25:45 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[7223]: 2007/09/19_14:25:45 info: Break tie for 2 nodes cluster ccm[7223]: 2007/09/19_14:25:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7224]: 2007/09/19_14:25:47 info: cib_init: Starting cib mainloop cib[7224]: 2007/09/19_14:25:47 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[7224]: 2007/09/19_14:25:47 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[7224]: 2007/09/19_14:25:47 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:25:47 info: main: Starting mainloop cib[7230]: 2007/09/19_14:25:47 WARN: validate_cib_digest: No on-disk digest present crmd[7228]: 2007/09/19_14:25:47 info: do_cib_control: CIB connection established cib[7224]: 2007/09/19_14:25:47 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[7228]: 2007/09/19_14:25:47 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[7224]: 2007/09/19_14:25:47 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[7224]: 2007/09/19_14:25:47 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[7224]: 2007/09/19_14:25:47 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[7224]: 2007/09/19_14:25:47 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[7230]: 2007/09/19_14:25:47 info: write_cib_contents: Wrote version 0.0.101 of the CIB to disk (digest: c697ffe4138e6cb1b1279651a61df712) crmd[7228]: 2007/09/19_14:25:47 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[7228]: 2007/09/19_14:25:47 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[7229]: 2007/09/19_14:25:48 info: Started. crmd[7228]: 2007/09/19_14:25:48 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[7228]: 2007/09/19_14:25:48 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[7228]: 2007/09/19_14:25:49 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[7228]: 2007/09/19_14:25:49 info: do_ha_control: Connected to Heartbeat crmd[7228]: 2007/09/19_14:25:49 info: do_ccm_control: CCM connection established... waiting for first callback crmd[7228]: 2007/09/19_14:25:49 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[7228]: 2007/09/19_14:25:49 info: crmd_init: Starting crmd's mainloop crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[7228]: 2007/09/19_14:25:49 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[7228]: 2007/09/19_14:25:49 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[7228]: 2007/09/19_14:25:49 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[7228]: 2007/09/19_14:25:49 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[7228]: 2007/09/19_14:25:49 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[7228]: 2007/09/19_14:25:49 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[7228]: 2007/09/19_14:25:49 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[7228]: 2007/09/19_14:25:49 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[7228]: 2007/09/19_14:25:49 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7228]: 2007/09/19_14:25:49 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7228]: 2007/09/19_14:25:49 info: do_started: The local CRM is operational crmd[7228]: 2007/09/19_14:25:49 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[7228]: 2007/09/19_14:25:49 info: update_dc: Set DC to () cibmon[7222]: 2007/09/19_14:25:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:25:49 info: log_cib_diff: cib_update: Local-only Change: 0.0.101 cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:25:49 info: log_cib_diff: cib_update: Local-only Change: 0.0.101 cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:25:49 info: log_data_element: cib_update: + attrd[7227]: 2007/09/19_14:25:52 info: main: Starting mainloop... crmd[7228]: 2007/09/19_14:27:50 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[7228]: 2007/09/19_14:27:50 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[7228]: 2007/09/19_14:27:50 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[7228]: 2007/09/19_14:27:50 info: update_dc: Set DC to () crmd[7228]: 2007/09/19_14:27:51 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[7228]: 2007/09/19_14:27:51 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[7228]: 2007/09/19_14:27:51 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[7228]: 2007/09/19_14:27:51 info: start_subsystem: Starting sub-system "tengine" crmd[7228]: 2007/09/19_14:27:51 info: start_subsystem: Starting sub-system "pengine" crmd[7228]: 2007/09/19_14:27:51 info: do_dc_takeover: Taking over DC status for this partition crmd[7228]: 2007/09/19_14:27:51 info: update_dc: Set DC to () crmd[7228]: 2007/09/19_14:27:51 info: join_make_offer: Making join offers based on membership 1 crmd[7228]: 2007/09/19_14:27:51 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cib[7224]: 2007/09/19_14:27:51 info: cib_process_readwrite: We are now in R/W mode cibmon[7222]: 2007/09/19_14:27:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:51 info: log_cib_diff: cib_update: Diff: --- 0.0.101 cibmon[7222]: 2007/09/19_14:27:51 info: log_cib_diff: cib_update: Diff: +++ 0.0.102 tengine[7239]: 2007/09/19_14:27:51 info: G_main_add_SignalHandler: Added signal handler for signal 15 cibmon[7222]: 2007/09/19_14:27:51 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:51 info: G_main_add_TriggerHandler: Added signal manual handler cibmon[7222]: 2007/09/19_14:27:51 info: log_data_element: cib_update: + cib[7224]: 2007/09/19_14:27:51 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[7239]: 2007/09/19_14:27:51 info: te_init: Registering TE UUID: 778c148c-2b89-48bc-acc4-5c318277105d tengine[7239]: 2007/09/19_14:27:51 info: set_graph_functions: Setting custom graph functions tengine[7239]: 2007/09/19_14:27:51 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[7239]: 2007/09/19_14:27:51 info: te_init: Starting tengine pengine[7240]: 2007/09/19_14:27:51 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[7240]: 2007/09/19_14:27:51 info: pe_init: Starting pengine crmd[7228]: 2007/09/19_14:27:51 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7228]: 2007/09/19_14:27:51 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] cib[7224]: 2007/09/19_14:27:51 info: sync_our_cib: Syncing CIB to all peers crmd[7228]: 2007/09/19_14:27:51 info: do_state_transition: All 1 cluster nodes responded to the join offer. attrd[7227]: 2007/09/19_14:27:51 info: attrd_local_callback: Sending full refresh crmd[7228]: 2007/09/19_14:27:51 info: update_attrd: Connecting to attrd... cibmon[7222]: 2007/09/19_14:27:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:51 info: log_cib_diff: cib_update: Diff: --- 0.0.102 cibmon[7222]: 2007/09/19_14:27:51 info: log_cib_diff: cib_update: Diff: +++ 0.0.103 cibmon[7222]: 2007/09/19_14:27:51 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:51 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: --- 0.0.103 cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: +++ 0.0.104 cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:52 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7228]: 2007/09/19_14:27:52 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[7228]: 2007/09/19_14:27:52 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: --- 0.0.104 crmd[7228]: 2007/09/19_14:27:52 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[7239]: 2007/09/19_14:27:52 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: +++ 0.0.105 tengine[7239]: 2007/09/19_14:27:52 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + pengine[7240]: 2007/09/19_14:27:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:27:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:27:52 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:27:52 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:27:52 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:27:52 info: native_print: msg_1 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: daemontools_2 (heartbeat:daemontools): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: drbddisk_3 (heartbeat:drbddisk): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: mysql (heartbeat:mysql): Stopped pengine[7240]: 2007/09/19_14:27:52 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start msg_1 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca msg_1_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start daemontools_2 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca daemontools_2_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start drbddisk_3 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca drbddisk_3_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start Filesystem_4 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca Filesystem_4_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start drbdlinks_5 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca drbdlinks_5_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 notice: StartRsc: host-1.awale.qc.ca Start msg_8 pengine[7240]: 2007/09/19_14:27:52 notice: RecurringOp: host-1.awale.qc.ca msg_8_monitor_120000 pengine[7240]: 2007/09/19_14:27:52 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-29.bz2 crmd[7228]: 2007/09/19_14:27:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:27:52 info: unpack_graph: Unpacked transition 0: 28 actions in 28 synapses tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 3: msg_1_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 4: daemontools_2_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 5: drbddisk_3_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 6: Filesystem_4_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 7: drbdlinks_5_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 8: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=msg_1_monitor_0 key=3:0:778c148c-2b89-48bc-acc4-5c318277105d) tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 9: mysql_monitor_0 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:52 info: send_rsc_command: Initiating action 10: msg_8_monitor_0 on host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=daemontools_2_monitor_0 key=4:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=drbddisk_3_monitor_0 key=5:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=Filesystem_4_monitor_0 key=6:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=drbdlinks_5_monitor_0 key=7:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=8:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=9:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: do_lrm_rsc_op: Performing op=msg_8_monitor_0 key=10:0:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:52 info: process_lrm_event: LRM operation drbddisk_3_monitor_0 (call=4, rc=7) complete cibmon[7222]: 2007/09/19_14:27:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:52 info: match_graph_event: Action drbddisk_3_monitor_0 (5) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: --- 0.0.105 cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: +++ 0.0.106 cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:52 info: process_lrm_event: LRM operation daemontools_2_monitor_0 (call=3, rc=7) complete cibmon[7222]: 2007/09/19_14:27:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:52 info: match_graph_event: Action daemontools_2_monitor_0 (4) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: --- 0.0.106 cibmon[7222]: 2007/09/19_14:27:52 info: log_cib_diff: cib_update: Diff: +++ 0.0.107 cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:52 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:53 info: process_lrm_event: LRM operation msg_1_monitor_0 (call=2, rc=7) complete cibmon[7222]: 2007/09/19_14:27:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:53 info: match_graph_event: Action msg_1_monitor_0 (3) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: --- 0.0.107 cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: +++ 0.0.108 cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:53 info: process_lrm_event: LRM operation Filesystem_4_monitor_0 (call=5, rc=7) complete cibmon[7222]: 2007/09/19_14:27:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:53 info: match_graph_event: Action Filesystem_4_monitor_0 (6) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: --- 0.0.108 cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: +++ 0.0.109 cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + lrmd[7304]: 2007/09/19_14:27:53 ERROR: (raexechb.c:execra:247) execv failed for /etc/ha.d/resource.d//mysql: No such file or directory crmd[7228]: 2007/09/19_14:27:53 info: process_lrm_event: LRM operation mysql_monitor_0 (call=8, rc=7) complete lrmd[7225]: 2007/09/19_14:27:53 CRIT: read_pipe:3480 Attempt to read from closed file descriptor 13. lrmd[7225]: 2007/09/19_14:27:53 notice: read_pipe::3486: lrmd_op has been freed cibmon[7222]: 2007/09/19_14:27:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:53 info: match_graph_event: Action mysql_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: --- 0.0.109 cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: +++ 0.0.110 cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:53 info: process_lrm_event: LRM operation drbdlinks_5_monitor_0 (call=6, rc=7) complete cibmon[7222]: 2007/09/19_14:27:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:53 info: match_graph_event: Action drbdlinks_5_monitor_0 (7) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: --- 0.0.110 cibmon[7222]: 2007/09/19_14:27:53 info: log_cib_diff: cib_update: Diff: +++ 0.0.111 cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:53 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete crmd[7228]: 2007/09/19_14:27:54 info: process_lrm_event: LRM operation msg_8_monitor_0 (call=9, rc=7) complete cibmon[7222]: 2007/09/19_14:27:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: --- 0.0.111 tengine[7239]: 2007/09/19_14:27:54 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (8) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: +++ 0.0.112 cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:54 info: match_graph_event: Action msg_8_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: --- 0.0.112 tengine[7239]: 2007/09/19_14:27:54 info: send_rsc_command: Initiating action 2: probe_complete on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: +++ 0.0.113 tengine[7239]: 2007/09/19_14:27:54 info: te_pseudo_action: Pseudo action 1 fired and confirmed cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:54 info: te_pseudo_action: Pseudo action 27 fired and confirmed cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:54 info: send_rsc_command: Initiating action 11: msg_1_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:54 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:54 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:54 info: do_lrm_rsc_op: Performing op=msg_1_start_0 key=11:0:778c148c-2b89-48bc-acc4-5c318277105d) tengine[7239]: 2007/09/19_14:27:54 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_modify: Diff: --- 0.0.113 cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_modify: Diff: +++ 0.0.114 cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_modify: + msg[7335][7356]: 2007/09/19_14:27:54 INFO Starting to switch to this node. msg[7335][7357]: 2007/09/19_14:27:54 INFO Node: host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:54 info: process_lrm_event: LRM operation msg_1_start_0 (call=10, rc=0) complete crmd[7228]: 2007/09/19_14:27:54 info: build_operation_update: Digest for 0:0;11:0:778c148c-2b89-48bc-acc4-5c318277105d (msg_1_start_0) was fd931b345f577de4ab73115496330fb5 crmd[7228]: 2007/09/19_14:27:54 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: --- 0.0.114 cibmon[7222]: 2007/09/19_14:27:54 info: log_cib_diff: cib_update: Diff: +++ 0.0.115 tengine[7239]: 2007/09/19_14:27:54 info: match_graph_event: Action msg_1_start_0 (11) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:54 info: run_graph: ==================================================== cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:54 notice: run_graph: Transition 0: (Complete=12, Pending=0, Fired=0, Skipped=16, Incomplete=0) cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:54 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:54 info: log_data_element: cib_update: + pengine[7240]: 2007/09/19_14:27:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:27:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:27:54 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:27:54 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:27:54 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:27:54 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:54 info: native_print: daemontools_2 (heartbeat:daemontools): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: drbddisk_3 (heartbeat:drbddisk): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: mysql (heartbeat:mysql): Stopped pengine[7240]: 2007/09/19_14:27:54 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:27:54 notice: NoRoleChange: Leave resource msg_1 (host-1.awale.qc.ca) pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca msg_1_monitor_120000 crmd[7228]: 2007/09/19_14:27:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start daemontools_2 pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca daemontools_2_monitor_120000 pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start drbddisk_3 pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca drbddisk_3_monitor_120000 pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start Filesystem_4 pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca Filesystem_4_monitor_120000 pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start drbdlinks_5 pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca drbdlinks_5_monitor_120000 tengine[7239]: 2007/09/19_14:27:54 info: unpack_graph: Unpacked transition 1: 18 actions in 18 synapses pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7240]: 2007/09/19_14:27:54 notice: StartRsc: host-1.awale.qc.ca Start msg_8 tengine[7239]: 2007/09/19_14:27:54 info: te_pseudo_action: Pseudo action 20 fired and confirmed pengine[7240]: 2007/09/19_14:27:54 notice: RecurringOp: host-1.awale.qc.ca msg_8_monitor_120000 tengine[7239]: 2007/09/19_14:27:54 info: send_rsc_command: Initiating action 4: msg_1_start_0 on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:54 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-30.bz2 crmd[7228]: 2007/09/19_14:27:54 info: do_lrm_rsc_op: Performing op=msg_1_start_0 key=4:1:778c148c-2b89-48bc-acc4-5c318277105d) msg[7367][7388]: 2007/09/19_14:27:54 INFO Starting to switch to this node. msg[7367][7389]: 2007/09/19_14:27:54 INFO Node: host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation msg_1_start_0 (call=11, rc=0) complete crmd[7228]: 2007/09/19_14:27:55 info: build_operation_update: Digest for 0:0;4:1:778c148c-2b89-48bc-acc4-5c318277105d (msg_1_start_0) was fd931b345f577de4ab73115496330fb5 crmd[7228]: 2007/09/19_14:27:55 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action msg_1_start_0 (4) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.115 crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=msg_1_monitor_120000 key=5:1:778c148c-2b89-48bc-acc4-5c318277105d) tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 5: msg_1_monitor_120000 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.116 tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 6: daemontools_2_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=daemontools_2_start_0 key=6:1:778c148c-2b89-48bc-acc4-5c318277105d) cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + daemontools[7400][7416]: 2007/09/19_14:27:55 INFO Starting vmstat-mon crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation daemontools_2_start_0 (call=13, rc=0) complete crmd[7228]: 2007/09/19_14:27:55 info: build_operation_update: Digest for 0:0;6:1:778c148c-2b89-48bc-acc4-5c318277105d (daemontools_2_start_0) was fc6bc594585b5257746b70870f132329 crmd[7228]: 2007/09/19_14:27:55 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.116 tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action daemontools_2_start_0 (6) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.117 tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 7: daemontools_2_monitor_120000 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation msg_1_monitor_120000 (call=12, rc=0) complete tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 8: drbddisk_3_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=daemontools_2_monitor_120000 key=7:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=drbddisk_3_start_0 key=8:1:778c148c-2b89-48bc-acc4-5c318277105d) cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.117 cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.118 cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action msg_1_monitor_120000 (5) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation drbddisk_3_start_0 (call=15, rc=0) complete crmd[7228]: 2007/09/19_14:27:55 info: build_operation_update: Digest for 0:0;8:1:778c148c-2b89-48bc-acc4-5c318277105d (drbddisk_3_start_0) was eaef18223bea84e8b011465368d9f74e crmd[7228]: 2007/09/19_14:27:55 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.118 cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.119 cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action drbddisk_3_start_0 (8) confirmed on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 9: drbddisk_3_monitor_120000 on host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:27:55 info: send_rsc_command: Initiating action 10: Filesystem_4_start_0 on host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=drbddisk_3_monitor_120000 key=9:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:55 info: do_lrm_rsc_op: Performing op=Filesystem_4_start_0 key=10:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation drbddisk_3_monitor_120000 (call=16, rc=0) complete crmd[7228]: 2007/09/19_14:27:55 info: process_lrm_event: LRM operation daemontools_2_monitor_120000 (call=14, rc=0) complete cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action drbddisk_3_monitor_120000 (9) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.119 cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.120 cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:55 info: match_graph_event: Action daemontools_2_monitor_120000 (7) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: --- 0.0.120 cibmon[7222]: 2007/09/19_14:27:55 info: log_cib_diff: cib_update: Diff: +++ 0.0.121 cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:55 info: log_data_element: cib_update: + Filesystem[7443][7478]: 2007/09/19_14:27:56 INFO: Running start for /dev/drbd0 on /share crmd[7228]: 2007/09/19_14:27:56 info: process_lrm_event: LRM operation Filesystem_4_start_0 (call=17, rc=0) complete crmd[7228]: 2007/09/19_14:27:56 info: build_operation_update: Digest for 0:0;10:1:778c148c-2b89-48bc-acc4-5c318277105d (Filesystem_4_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[7228]: 2007/09/19_14:27:56 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:56 info: match_graph_event: Action Filesystem_4_start_0 (10) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: --- 0.0.121 tengine[7239]: 2007/09/19_14:27:56 info: send_rsc_command: Initiating action 11: Filesystem_4_monitor_120000 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: +++ 0.0.122 tengine[7239]: 2007/09/19_14:27:56 info: send_rsc_command: Initiating action 12: drbdlinks_5_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:56 info: do_lrm_rsc_op: Performing op=Filesystem_4_monitor_120000 key=11:1:778c148c-2b89-48bc-acc4-5c318277105d) cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:56 info: do_lrm_rsc_op: Performing op=drbdlinks_5_start_0 key=12:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:56 info: process_lrm_event: LRM operation drbdlinks_5_start_0 (call=19, rc=0) complete crmd[7228]: 2007/09/19_14:27:56 info: build_operation_update: Digest for 0:0;12:1:778c148c-2b89-48bc-acc4-5c318277105d (drbdlinks_5_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[7228]: 2007/09/19_14:27:56 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:56 info: match_graph_event: Action drbdlinks_5_start_0 (12) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: --- 0.0.122 tengine[7239]: 2007/09/19_14:27:56 info: send_rsc_command: Initiating action 13: drbdlinks_5_monitor_120000 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: +++ 0.0.123 tengine[7239]: 2007/09/19_14:27:56 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:56 info: do_lrm_rsc_op: Performing op=drbdlinks_5_monitor_120000 key=13:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=14:1:778c148c-2b89-48bc-acc4-5c318277105d) crmd[7228]: 2007/09/19_14:27:56 info: process_lrm_event: LRM operation drbdlinks_5_monitor_120000 (call=20, rc=0) complete cibmon[7222]: 2007/09/19_14:27:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:56 info: match_graph_event: Action drbdlinks_5_monitor_120000 (13) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: --- 0.0.123 cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: +++ 0.0.124 cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:56 info: process_lrm_event: LRM operation Filesystem_4_monitor_120000 (call=18, rc=0) complete cibmon[7222]: 2007/09/19_14:27:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:56 info: match_graph_event: Action Filesystem_4_monitor_120000 (11) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: --- 0.0.124 cibmon[7222]: 2007/09/19_14:27:56 info: log_cib_diff: cib_update: Diff: +++ 0.0.125 cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:56 info: log_data_element: cib_update: + IPaddr[7528][7568]: 2007/09/19_14:27:57 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[7528][7573]: 2007/09/19_14:27:57 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[7528][7595]: 2007/09/19_14:27:57 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[7228]: 2007/09/19_14:27:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=21, rc=0) complete crmd[7228]: 2007/09/19_14:27:57 info: build_operation_update: Digest for 0:0;14:1:778c148c-2b89-48bc-acc4-5c318277105d (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[7228]: 2007/09/19_14:27:57 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:57 info: log_cib_diff: cib_update: Diff: --- 0.0.125 crmd[7228]: 2007/09/19_14:27:57 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=15:1:778c148c-2b89-48bc-acc4-5c318277105d) tengine[7239]: 2007/09/19_14:27:57 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (14) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:57 info: log_cib_diff: cib_update: Diff: +++ 0.0.126 tengine[7239]: 2007/09/19_14:27:57 info: send_rsc_command: Initiating action 15: IPaddr_10_0_0_59_monitor_5000 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:57 info: send_rsc_command: Initiating action 16: mysql_start_0 on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:57 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=16:1:778c148c-2b89-48bc-acc4-5c318277105d) lrmd[7628]: 2007/09/19_14:27:57 ERROR: (raexechb.c:execra:247) execv failed for /etc/ha.d/resource.d//mysql: No such file or directory crmd[7228]: 2007/09/19_14:27:57 ERROR: process_lrm_event: LRM operation mysql_start_0 (call=23, rc=254) Error crmd[7228]: 2007/09/19_14:27:57 info: build_operation_update: Digest for 4:254;16:1:778c148c-2b89-48bc-acc4-5c318277105d (mysql_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[7228]: 2007/09/19_14:27:57 info: log_data_element: build_operation_update: digest:source cibmon[7222]: 2007/09/19_14:27:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:27:57 WARN: status_from_rc: Action start on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[7222]: 2007/09/19_14:27:57 info: log_cib_diff: cib_update: Diff: --- 0.0.126 tengine[7239]: 2007/09/19_14:27:57 info: update_abort_priority: Abort priority upgraded to 1 cibmon[7222]: 2007/09/19_14:27:57 info: log_cib_diff: cib_update: Diff: +++ 0.0.127 tengine[7239]: 2007/09/19_14:27:57 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:57 info: match_graph_event: Action mysql_start_0 (16) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:57 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=0) complete cibmon[7222]: 2007/09/19_14:27:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:58 info: log_cib_diff: cib_update: Diff: --- 0.0.127 cibmon[7222]: 2007/09/19_14:27:58 info: log_cib_diff: cib_update: Diff: +++ 0.0.128 cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:58 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (15) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:58 info: run_graph: ==================================================== cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:58 notice: run_graph: Transition 1: (Complete=14, Pending=0, Fired=0, Skipped=4, Incomplete=0) cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:27:58 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:27:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:27:58 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca FAILED pengine[7240]: 2007/09/19_14:27:58 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource msg_1 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource daemontools_2 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource drbddisk_3 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource Filesystem_4 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource drbdlinks_5 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource mysql cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource msg_8 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[7240]: 2007/09/19_14:27:58 WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-5.bz2 pengine[7240]: 2007/09/19_14:27:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:27:58 info: unpack_graph: Unpacked transition 2: 10 actions in 10 synapses tengine[7239]: 2007/09/19_14:27:58 info: te_pseudo_action: Pseudo action 18 fired and confirmed tengine[7239]: 2007/09/19_14:27:58 info: te_pseudo_action: Pseudo action 27 fired and confirmed tengine[7239]: 2007/09/19_14:27:58 info: send_rsc_command: Initiating action 5: mysql_stop_0 on host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:27:58 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=5:2:778c148c-2b89-48bc-acc4-5c318277105d) lrmd[7640]: 2007/09/19_14:27:58 ERROR: (raexechb.c:execra:247) execv failed for /etc/ha.d/resource.d//mysql: No such file or directory crmd[7228]: 2007/09/19_14:27:58 ERROR: process_lrm_event: LRM operation mysql_stop_0 (call=24, rc=254) Error cibmon[7222]: 2007/09/19_14:27:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7222]: 2007/09/19_14:27:58 info: log_cib_diff: cib_update: Diff: --- 0.0.128 cibmon[7222]: 2007/09/19_14:27:58 info: log_cib_diff: cib_update: Diff: +++ 0.0.129 cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:27:58 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:58 info: update_abort_priority: Abort priority upgraded to 1 cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:27:58 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[7239]: 2007/09/19_14:27:58 info: match_graph_event: Action mysql_stop_0 (5) confirmed on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:58 info: run_graph: ==================================================== cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:27:58 notice: run_graph: Transition 2: (Complete=3, Pending=0, Fired=0, Skipped=7, Incomplete=0) cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:27:58 info: log_data_element: cib_update: + pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:27:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:27:58 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:27:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:27:58 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:27:58 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[7240]: 2007/09/19_14:27:58 info: native_print: msg_8 (heartbeat:msg): Stopped crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource msg_1 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource daemontools_2 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource drbddisk_3 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource Filesystem_4 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource drbdlinks_5 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource mysql cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 WARN: native_color: Resource msg_8 cannot run anywhere pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 pengine[7240]: 2007/09/19_14:27:58 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7240]: 2007/09/19_14:27:58 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[7239]: 2007/09/19_14:27:58 info: unpack_graph: Unpacked transition 3: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:27:58 WARN: should_dump_action: action 15 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:27:58 info: te_pseudo_action: Pseudo action 18 fired and confirmed pengine[7240]: 2007/09/19_14:27:58 WARN: should_dump_action: action 15 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:27:58 info: te_pseudo_action: Pseudo action 27 fired and confirmed tengine[7239]: 2007/09/19_14:27:58 notice: run_graph: ==================================================== tengine[7239]: 2007/09/19_14:27:58 WARN: run_graph: Transition 3: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) crmd[7228]: 2007/09/19_14:27:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:27:58 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:27:58 WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-6.bz2 tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:27:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 1 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 19]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 9]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 15]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 2 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 9]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: [Action 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 15]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:27:58 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:27:58 info: notify_crmd: Transition 3 status: te_complete - cib[7224]: 2007/09/19_14:35:47 info: cib_stats: Processed 53 operations (10566.00us average, 0% utilization) in the last 10min cibmon[7222]: 2007/09/19_14:35:50 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[7239]: 2007/09/19_14:35:50 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:35:50 info: log_cib_diff: cib_modify: Diff: --- 0.0.129 crmd[7228]: 2007/09/19_14:35:50 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7222]: 2007/09/19_14:35:50 info: log_cib_diff: cib_modify: Diff: +++ 0.1.1 crmd[7228]: 2007/09/19_14:35:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:35:50 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:35:50 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:35:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:35:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:35:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:35:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:35:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:35:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:35:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:35:50 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:35:50 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:35:50 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[7240]: 2007/09/19_14:35:50 info: native_print: msg_8 (heartbeat:msg): Stopped crmd[7228]: 2007/09/19_14:35:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:35:50 info: unpack_graph: Unpacked transition 4: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:35:50 info: log_data_element: check_action_definition: params:all crmd[7228]: 2007/09/19_14:35:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:35:50 info: te_pseudo_action: Pseudo action 19 fired and confirmed pengine[7240]: 2007/09/19_14:35:50 WARN: check_action_definition: Parameters to daemontools_2_start_0 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:35:50 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[7240]: 2007/09/19_14:35:50 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:35:50 notice: run_graph: ==================================================== pengine[7240]: 2007/09/19_14:35:50 WARN: check_action_definition: Parameters to daemontools_2_monitor_120000 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:35:50 WARN: run_graph: Transition 4: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource msg_1 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource daemontools_2 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource drbddisk_3 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource Filesystem_4 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 20]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource drbdlinks_5 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 10]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 11]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource mysql cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 12]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: native_color: Resource msg_8 cannot run anywhere tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 13]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 14]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 15]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 16]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 cib[9354]: 2007/09/19_14:35:50 info: write_cib_contents: Wrote version 0.1.1 of the CIB to disk (digest: b0bd065a7f0f483ebcca8d305c7f7985) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:35:50 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 10]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: should_dump_action: action 16 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 11]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: should_dump_action: action 16 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:35:50 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-7.bz2 tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[7240]: 2007/09/19_14:35:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 11]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 12]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 12]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 13]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 13]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 14]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 14]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 15]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: [Action 15]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 16]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_elem: * [Input 19]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:35:50 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:35:50 info: notify_crmd: Transition 4 status: te_complete - heartbeat[10091]: 2007/09/19_14:39:20 info: No log entry found in ha.cf -- use logd heartbeat[10091]: 2007/09/19_14:39:20 info: Enabling logging daemon heartbeat[7180]: 2007/09/19_14:39:20 info: Configuration unchanged. heartbeat[10091]: 2007/09/19_14:39:20 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[10091]: 2007/09/19_14:39:20 info: Signalling heartbeat pid 7180 to reread config files cibmon[7222]: 2007/09/19_14:39:46 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:39:46 info: log_cib_diff: cib_modify: Local-only Change: 0.2.1 crmd[7228]: 2007/09/19_14:39:46 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: - tengine[7239]: 2007/09/19_14:39:46 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[7240]: 2007/09/19_14:39:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: - crmd[7228]: 2007/09/19_14:39:46 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 info: unpack_graph: Unpacked transition 5: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + crmd[7228]: 2007/09/19_14:39:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 info: te_pseudo_action: Pseudo action 20 fired and confirmed pengine[7240]: 2007/09/19_14:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + crmd[7228]: 2007/09/19_14:39:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[7240]: 2007/09/19_14:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 notice: run_graph: ==================================================== pengine[7240]: 2007/09/19_14:39:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: run_graph: Transition 5: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[7240]: 2007/09/19_14:39:46 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:39:46 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 21]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: group_print: Resource Group: group_1 cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:39:46 info: log_data_element: cib:diff: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:39:46 info: log_data_element: cib_modify: + tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: native_print: msg_8 (heartbeat:msg): Stopped tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: check_action_definition: Parameters to daemontools_2_start_0 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: check_action_definition: Parameters to daemontools_2_monitor_120000 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: check_action_definition: Parameters to mysql_start_0 on host-1.awale.qc.ca changed: recorded f2317cad3d54cec5d7d7aa7d0bf35cf8 vs. calculated (all) 08b7001b97ccdaa1ca23a9f165256bc1 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource msg_1 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 4 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource daemontools_2 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource drbddisk_3 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource Filesystem_4 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource drbdlinks_5 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 5 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource mysql cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: native_color: Resource msg_8 cannot run anywhere tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 6 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 7 is pending (priority: 0) pengine[7240]: 2007/09/19_14:39:46 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: [Action 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: custom_action: Action mysql_stop_0 (unmanaged) cib[10173]: 2007/09/19_14:39:46 ERROR: validate_cib_digest: Digest comparision failed: b0bd065a7f0f483ebcca8d305c7f7985 vs. ef9567213a821e793be3c58c7f723b94 tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cib[10173]: 2007/09/19_14:39:46 ERROR: write_cib_contents: /var/lib/heartbeat/crm/cib.xml was manually modified while Heartbeat was active! tengine[7239]: 2007/09/19_14:39:46 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:39:46 WARN: print_graph: Synapse 8 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:39:46 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-8.bz2 tengine[7239]: 2007/09/19_14:39:46 info: notify_crmd: Transition 5 status: te_complete - pengine[7240]: 2007/09/19_14:39:46 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[7224]: 2007/09/19_14:39:46 ERROR: cib_diskwrite_complete: Disk write failed: status=256, signo=0, exitcode=1 cib[7224]: 2007/09/19_14:39:46 ERROR: cib_diskwrite_complete: Disabling disk writes after write failure cibmon[7222]: 2007/09/19_14:40:32 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:40:32 info: log_cib_diff: cib_modify: Diff: --- 0.2.1 cibmon[7222]: 2007/09/19_14:40:32 info: log_cib_diff: cib_modify: Diff: +++ 0.2.2 cibmon[7222]: 2007/09/19_14:40:32 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:40:32 info: log_data_element: cib_modify: + heartbeat[10584]: 2007/09/19_14:41:37 info: No log entry found in ha.cf -- use logd heartbeat[10584]: 2007/09/19_14:41:37 info: Enabling logging daemon heartbeat[10584]: 2007/09/19_14:41:37 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[10584]: 2007/09/19_14:41:37 info: Signalling heartbeat pid 7180 to reread config files heartbeat[7180]: 2007/09/19_14:41:37 info: Configuration unchanged. cibmon[7222]: 2007/09/19_14:41:46 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:41:46 info: log_cib_diff: cib_modify: Diff: --- 0.2.2 cibmon[7222]: 2007/09/19_14:41:46 info: log_cib_diff: cib_modify: Diff: +++ 0.2.3 cibmon[7222]: 2007/09/19_14:41:46 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:41:46 info: log_data_element: cib_modify: + heartbeat[10908]: 2007/09/19_14:43:00 info: No log entry found in ha.cf -- use logd heartbeat[10908]: 2007/09/19_14:43:00 info: Enabling logging daemon heartbeat[7180]: 2007/09/19_14:43:00 info: Configuration unchanged. heartbeat[10908]: 2007/09/19_14:43:00 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[10908]: 2007/09/19_14:43:00 info: Signalling heartbeat pid 7180 to reread config files cibmon[7222]: 2007/09/19_14:43:57 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:43:57 info: log_cib_diff: cib_modify: Diff: --- 0.2.3 cibmon[7222]: 2007/09/19_14:43:57 info: log_cib_diff: cib_modify: Diff: +++ 0.2.4 cibmon[7222]: 2007/09/19_14:43:57 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:43:57 info: log_data_element: cib_modify: + cibmon[7222]: 2007/09/19_14:44:13 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_cib_diff: cib_modify: Diff: --- 0.2.4 cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - tengine[7239]: 2007/09/19_14:44:13 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:44:13 info: log_cib_diff: cib_modify: Diff: +++ 0.3.1 crmd[7228]: 2007/09/19_14:44:13 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - crmd[7228]: 2007/09/19_14:44:13 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:13 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:13 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:44:13 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:44:13 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:44:13 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:44:13 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:44:13 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:13 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:44:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:44:13 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:13 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:13 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:13 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[7239]: 2007/09/19_14:44:13 info: unpack_graph: Unpacked transition 6: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:44:13 info: native_print: msg_8 (heartbeat:msg): Stopped tengine[7239]: 2007/09/19_14:44:13 info: te_pseudo_action: Pseudo action 20 fired and confirmed pengine[7240]: 2007/09/19_14:44:13 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:44:13 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[7240]: 2007/09/19_14:44:13 WARN: check_action_definition: Parameters to daemontools_2_start_0 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:44:13 notice: run_graph: ==================================================== pengine[7240]: 2007/09/19_14:44:13 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:44:13 WARN: run_graph: Transition 6: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[7240]: 2007/09/19_14:44:13 WARN: check_action_definition: Parameters to daemontools_2_monitor_120000 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:44:13 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:44:13 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: check_action_definition: Parameters to mysql_start_0 on host-1.awale.qc.ca changed: recorded f2317cad3d54cec5d7d7aa7d0bf35cf8 vs. calculated (all) e1c46569e84224c134048167b5c96b36 tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource msg_1 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 21]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource daemontools_2 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource drbddisk_3 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource Filesystem_4 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource drbdlinks_5 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource mysql cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: native_color: Resource msg_8 cannot run anywhere tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 crmd[7228]: 2007/09/19_14:44:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:13 WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-9.bz2 tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:13 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: [Action 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:13 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:44:13 info: notify_crmd: Transition 6 status: te_complete - cibmon[7222]: 2007/09/19_14:44:29 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - tengine[7239]: 2007/09/19_14:44:29 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:44:29 info: log_cib_diff: cib_modify: Local-only Change: 0.4.1 crmd[7228]: 2007/09/19_14:44:29 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - crmd[7228]: 2007/09/19_14:44:29 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:29 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:29 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:44:29 ERROR: text2role: Unknown role: startted cibmon[7222]: 2007/09/19_14:44:29 info: log_data_element: cib_modify: + pengine[7240]: 2007/09/19_14:44:29 ERROR: common_unpack: mysql: Unknown value for target_role: startted pengine[7240]: 2007/09/19_14:44:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7240]: 2007/09/19_14:44:29 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 ERROR: text2role: Unknown role: startted pengine[7240]: 2007/09/19_14:44:29 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:44:29 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:29 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[7240]: 2007/09/19_14:44:29 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:44:29 info: log_data_element: check_action_definition: params:all crmd[7228]: 2007/09/19_14:44:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:44:29 WARN: check_action_definition: Parameters to daemontools_2_start_0 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 pengine[7240]: 2007/09/19_14:44:29 info: log_data_element: check_action_definition: params:all pengine[7240]: 2007/09/19_14:44:29 WARN: check_action_definition: Parameters to daemontools_2_monitor_120000 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 pengine[7240]: 2007/09/19_14:44:29 info: log_data_element: check_action_definition: params:all pengine[7240]: 2007/09/19_14:44:29 WARN: check_action_definition: Parameters to mysql_start_0 on host-1.awale.qc.ca changed: recorded f2317cad3d54cec5d7d7aa7d0bf35cf8 vs. calculated (all) 73d0e4e754bc25bca9a7725b2890b008 pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource msg_1 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource daemontools_2 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource drbddisk_3 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource Filesystem_4 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource drbdlinks_5 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource mysql cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 WARN: native_color: Resource msg_8 cannot run anywhere pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 tengine[7239]: 2007/09/19_14:44:29 info: unpack_graph: Unpacked transition 7: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 tengine[7239]: 2007/09/19_14:44:29 info: te_pseudo_action: Pseudo action 20 fired and confirmed pengine[7240]: 2007/09/19_14:44:29 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[7239]: 2007/09/19_14:44:29 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[7240]: 2007/09/19_14:44:29 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[7239]: 2007/09/19_14:44:29 notice: run_graph: ==================================================== pengine[7240]: 2007/09/19_14:44:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:29 WARN: run_graph: Transition 7: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[7240]: 2007/09/19_14:44:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:29 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:44:29 WARN: process_pe_message: Transition 7: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-10.bz2 tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:44:29 info: process_pe_message: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[7228]: 2007/09/19_14:44:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 1 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 21]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 2 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: [Action 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:29 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:44:29 info: notify_crmd: Transition 7 status: te_complete - cibmon[7222]: 2007/09/19_14:44:41 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7222]: 2007/09/19_14:44:41 info: log_cib_diff: cib_modify: Local-only Change: 0.5.1 cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - tengine[7239]: 2007/09/19_14:44:41 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - crmd[7228]: 2007/09/19_14:44:41 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - crmd[7228]: 2007/09/19_14:44:41 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: - cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: - cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[7222]: 2007/09/19_14:44:41 info: log_data_element: cib_modify: + cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 notice: unpack_config: On loss of CCM Quorum: Ignore cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 info: determine_online_status: Node host-1.awale.qc.ca is online cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cib[7224]: 2007/09/19_14:44:41 info: log_data_element: cib:diff: + pengine[7240]: 2007/09/19_14:44:41 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:44:41 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:44:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:44:41 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:44:41 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[7240]: 2007/09/19_14:44:41 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:44:41 info: log_data_element: check_action_definition: params:all pengine[7240]: 2007/09/19_14:44:41 WARN: check_action_definition: Parameters to daemontools_2_start_0 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 pengine[7240]: 2007/09/19_14:44:41 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:44:41 info: unpack_graph: Unpacked transition 8: 9 actions in 9 synapses pengine[7240]: 2007/09/19_14:44:41 WARN: check_action_definition: Parameters to daemontools_2_monitor_120000 on host-1.awale.qc.ca changed: recorded fc6bc594585b5257746b70870f132329 vs. calculated (all) 565d0e995d90a81dff17a2872da52bd8 tengine[7239]: 2007/09/19_14:44:41 info: te_pseudo_action: Pseudo action 20 fired and confirmed pengine[7240]: 2007/09/19_14:44:41 info: log_data_element: check_action_definition: params:all tengine[7239]: 2007/09/19_14:44:41 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[7240]: 2007/09/19_14:44:41 WARN: check_action_definition: Parameters to mysql_start_0 on host-1.awale.qc.ca changed: recorded f2317cad3d54cec5d7d7aa7d0bf35cf8 vs. calculated (all) 08b7001b97ccdaa1ca23a9f165256bc1 tengine[7239]: 2007/09/19_14:44:41 notice: run_graph: ==================================================== pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource msg_1 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: run_graph: Transition 8: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource daemontools_2 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 ERROR: te_graph_trigger: Transition failed: terminated pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource drbddisk_3 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource Filesystem_4 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource drbdlinks_5 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 21]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource mysql cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: native_color: Resource msg_8 cannot run anywhere tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:41 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 crmd[7228]: 2007/09/19_14:44:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 27]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 11]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[7240]: 2007/09/19_14:44:41 WARN: process_pe_message: Transition 8: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-11.bz2 tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:44:41 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 12]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 13]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 14]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 15]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: [Action 16]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 17]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_elem: * [Input 20]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:44:41 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:44:41 info: notify_crmd: Transition 8 status: te_complete - heartbeat[7180]: 2007/09/19_14:45:01 info: killing /usr/lib/heartbeat/mgmtd -v process group 7229 with signal 15 mgmtd[7229]: 2007/09/19_14:45:01 info: mgmtd is shutting down heartbeat[7180]: 2007/09/19_14:45:01 info: killing /usr/lib/heartbeat/crmd process group 7228 with signal 15 crmd[7228]: 2007/09/19_14:45:01 info: crm_shutdown: Requesting shutdown crmd[7228]: 2007/09/19_14:45:01 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] crmd[7228]: 2007/09/19_14:45:01 info: do_state_transition: All 1 cluster nodes are eligible to run resources. crmd[7228]: 2007/09/19_14:45:01 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[7228]: 2007/09/19_14:45:01 info: do_shutdown_req: Processing shutdown locally crmd[7228]: 2007/09/19_14:45:01 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca cibmon[7222]: 2007/09/19_14:45:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:45:01 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[7222]: 2007/09/19_14:45:01 info: log_cib_diff: cib_update: Diff: --- 0.5.1 tengine[7239]: 2007/09/19_14:45:01 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7222]: 2007/09/19_14:45:01 info: log_cib_diff: cib_update: Diff: +++ 0.5.2 cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + pengine[7240]: 2007/09/19_14:45:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7240]: 2007/09/19_14:45:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7240]: 2007/09/19_14:45:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7240]: 2007/09/19_14:45:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7240]: 2007/09/19_14:45:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7240]: 2007/09/19_14:45:01 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[7240]: 2007/09/19_14:45:01 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[7240]: 2007/09/19_14:45:01 WARN: unpack_rsc_op: Processing failed op (mysql_start_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 WARN: unpack_rsc_op: Handling failed start for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: group_print: Resource Group: group_1 pengine[7240]: 2007/09/19_14:45:01 info: native_print: msg_1 (heartbeat:msg): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: daemontools_2 (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: drbddisk_3 (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: Filesystem_4 (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: drbdlinks_5 (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7240]: 2007/09/19_14:45:01 info: native_print: mysql (heartbeat:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[7240]: 2007/09/19_14:45:01 info: native_print: msg_8 (heartbeat:msg): Stopped pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource msg_1 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource daemontools_2 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource drbddisk_3 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource Filesystem_4 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource drbdlinks_5 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource mysql cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 WARN: native_color: Resource msg_8 cannot run anywhere pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop msg_1 pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop daemontools_2 crmd[7228]: 2007/09/19_14:45:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop drbddisk_3 pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem_4 pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks_5 pengine[7240]: 2007/09/19_14:45:01 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7240]: 2007/09/19_14:45:01 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[7240]: 2007/09/19_14:45:01 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[7240]: 2007/09/19_14:45:01 WARN: should_dump_action: action 15 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:45:01 info: unpack_graph: Unpacked transition 9: 10 actions in 10 synapses pengine[7240]: 2007/09/19_14:45:01 WARN: should_dump_action: action 15 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[7239]: 2007/09/19_14:45:01 info: te_pseudo_action: Pseudo action 18 fired and confirmed tengine[7239]: 2007/09/19_14:45:01 info: te_pseudo_action: Pseudo action 28 fired and confirmed tengine[7239]: 2007/09/19_14:45:01 notice: run_graph: ==================================================== tengine[7239]: 2007/09/19_14:45:01 WARN: run_graph: Transition 9: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=8) crmd[7228]: 2007/09/19_14:45:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7239]: 2007/09/19_14:45:01 ERROR: te_graph_trigger: Transition failed: terminated crmd[7228]: 2007/09/19_14:45:01 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 0 was confirmed (priority: 0) crmd[7228]: 2007/09/19_14:45:01 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 1 is pending (priority: 0) crmd[7228]: 2007/09/19_14:45:01 info: do_shutdown_req: Processing shutdown locally tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 19]: Pending (id: group_1_stopped_0, type: pseduo, priority: 0) crmd[7228]: 2007/09/19_14:45:01 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 9]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 15]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 28]: Completed (id: msg_8_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 2 is pending (priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 9]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 3 is pending (priority: 0) cibmon[7222]: 2007/09/19_14:45:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[7222]: 2007/09/19_14:45:01 info: log_cib_diff: cib_update: Diff: --- 0.5.2 tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[7222]: 2007/09/19_14:45:01 info: log_cib_diff: cib_update: Diff: +++ 0.5.3 tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: - tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 4 is pending (priority: 0) cibmon[7222]: 2007/09/19_14:45:01 info: log_data_element: cib_update: + tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) pengine[7240]: 2007/09/19_14:45:01 WARN: process_pe_message: Transition 9: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-12.bz2 tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 5 is pending (priority: 0) pengine[7240]: 2007/09/19_14:45:01 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 15]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 18]: Completed (id: group_1_stop_0, type: pseduo, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_graph: Synapse 9 is pending (priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: [Action 20]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 9]: Pending (id: msg_1_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 10]: Pending (id: daemontools_2_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 11]: Pending (id: drbddisk_3_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 12]: Pending (id: Filesystem_4_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 13]: Pending (id: drbdlinks_5_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 WARN: print_elem: * [Input 14]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[7239]: 2007/09/19_14:45:01 info: notify_crmd: Transition 9 status: te_complete - cib[7224]: 2007/09/19_14:45:47 info: cib_stats: Processed 40 operations (7750.00us average, 0% utilization) in the last 10min heartbeat[7180]: 2007/09/19_14:53:31 info: Core process 7185 exited. 5 remaining heartbeat[7180]: 2007/09/19_14:53:31 info: Core process 7188 exited. 4 remaining heartbeat[7180]: 2007/09/19_14:53:31 info: Core process 7184 exited. 3 remaining heartbeat[7180]: 2007/09/19_14:53:31 info: Core process 7187 exited. 2 remaining heartbeat[7180]: 2007/09/19_14:53:31 info: Core process 7186 exited. 1 remaining heartbeat[7180]: 2007/09/19_14:53:31 info: host-1.awale.qc.ca Heartbeat shutdown complete. ccm[7223]: 2007/09/19_14:53:31 ERROR: Lost connection to heartbeat service. Need to bail out. cib[7224]: 2007/09/19_14:53:31 info: mem_handle_func:IPC broken, ccm is dead before the client! cib[7224]: 2007/09/19_14:53:31 ERROR: cib_ccm_dispatch: CCM connection appears to have failed: rc=-1. crmd[7228]: 2007/09/19_14:53:31 info: mem_handle_func:IPC broken, ccm is dead before the client! crmd[7228]: 2007/09/19_14:53:31 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1. crmd[7228]: 2007/09/19_14:53:31 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_IDLE) crmd[7228]: 2007/09/19_14:53:31 info: do_state_transition: State transition S_IDLE -> S_RECOVERY [ input=I_ERROR cause=C_CCM_CALLBACK origin=ccm_dispatch ] crmd[7228]: 2007/09/19_14:53:31 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported pengine[7240]: 2007/09/19_14:53:31 info: pengine_shutdown: Exiting PEngine (SIGTERM) crmd[7228]: 2007/09/19_14:53:31 WARN: do_election_vote: Not voting in election, we're in state S_RECOVERY crmd[7228]: 2007/09/19_14:53:31 info: do_dc_release: DC role released crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to pengine: [7240] crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to tengine: [7239] crmd[7228]: 2007/09/19_14:53:31 ERROR: do_log: [[FSA]] Input I_STOP from do_recover() received in state (S_RECOVERY) crmd[7228]: 2007/09/19_14:53:31 info: do_state_transition: State transition S_RECOVERY -> S_STOPPING [ input=I_STOP cause=C_FSA_INTERNAL origin=do_recover ] tengine[7239]: 2007/09/19_14:53:31 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[7228]: 2007/09/19_14:53:31 info: do_dc_release: DC role released tengine[7239]: 2007/09/19_14:53:31 info: update_abort_priority: Abort action 2 superceeded by 3 crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to pengine: [7240] tengine[7239]: 2007/09/19_14:53:31 info: notify_crmd: Exiting after transition crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to tengine: [7239] tengine[7239]: 2007/09/19_14:53:31 info: te_init: Exiting tengine crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Terminating the pengine crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to pengine: [7240] crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Terminating the tengine crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to tengine: [7239] crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Waiting for subsystems to exit crmd[7228]: 2007/09/19_14:53:31 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[7228]: 2007/09/19_14:53:31 WARN: do_log: [[FSA]] Input I_PENDING from do_election_vote() received in state (S_STOPPING) crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Terminating the pengine crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to pengine: [7240] crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Terminating the tengine crmd[7228]: 2007/09/19_14:53:31 info: stop_subsystem: Sent -TERM to tengine: [7239] crmd[7228]: 2007/09/19_14:53:31 info: do_shutdown: Waiting for subsystems to exit cib[7224]: 2007/09/19_14:53:31 ERROR: cib_ha_connection_destroy: Heartbeat connection lost! Exiting. crmd[7228]: 2007/09/19_14:53:31 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[7228]: 2007/09/19_14:53:31 info: crmdManagedChildDied: Process tengine:[7239] exited (signal=0, exitcode=0) cib[7224]: 2007/09/19_14:53:31 ERROR: crm_abort: main: Triggered non-fatal assert at main.c:213 : g_hash_table_size(client_list) == 0 crmd[7228]: 2007/09/19_14:53:31 info: crmdManagedChildDied: Process pengine:[7240] exited (signal=0, exitcode=0) cib[7224]: 2007/09/19_14:53:31 WARN: main: Not all clients gone at exit crmd[7228]: 2007/09/19_14:53:31 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) attrd[7227]: 2007/09/19_14:53:31 CRIT: attrd_ha_dispatch: Lost connection to heartbeat service. crmd[7228]: 2007/09/19_14:53:31 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) attrd[7227]: 2007/09/19_14:53:31 CRIT: attrd_ha_connection_destroy: Lost connection to heartbeat service! stonithd[7226]: 2007/09/19_14:53:31 ERROR: Disconnected with heartbeat daemon crmd[7228]: 2007/09/19_14:53:31 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] attrd[7227]: 2007/09/19_14:53:31 info: main: Exiting... stonithd[7226]: 2007/09/19_14:53:31 notice: /usr/lib/heartbeat/stonithd normally quit. crmd[7228]: 2007/09/19_14:53:31 info: verify_stopped: Checking for active resources before exit crmd[7228]: 2007/09/19_14:53:31 info: verify_stopped: Checking for active resources before exit crmd[7228]: 2007/09/19_14:53:31 CRIT: crmd_ha_msg_dispatch: Lost connection to heartbeat service. crmd[7228]: 2007/09/19_14:53:31 info: verify_stopped: Checking for active resources before exit crmd[7228]: 2007/09/19_14:53:31 info: process_client_disconnect: Received HUP from tengine:[-1] crmd[7228]: 2007/09/19_14:53:31 info: process_client_disconnect: Received HUP from pengine:[-1] crmd[7228]: 2007/09/19_14:53:31 info: verify_stopped: Checking for active resources before exit crmd[7228]: 2007/09/19_14:53:31 info: cib_native_msgready: Lost connection to the CIB service [7224]. crmd[7228]: 2007/09/19_14:53:31 CRIT: cib_native_dispatch: Lost connection to the CIB service [7224/callback]. crmd[7228]: 2007/09/19_14:53:31 ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[7228]: 2007/09/19_14:53:31 ERROR: do_log: [[FSA]] Input I_ERROR from crmd_cib_connection_destroy() received in state (S_TERMINATE) crmd[7228]: 2007/09/19_14:53:31 info: verify_stopped: Checking for active resources before exit crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: 6 pending LRM operations at shutdown cibmon[7222]: 2007/09/19_14:53:31 info: cib_native_msgready: Lost connection to the CIB service [7224]. crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: drbddisk_3:16 cibmon[7222]: 2007/09/19_14:53:31 CRIT: cib_native_dispatch: Lost connection to the CIB service [7224/callback]. crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: daemontools_2:14 crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: Filesystem_4:18 crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: msg_1:12 crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: drbdlinks_5:20 cibmon[7222]: 2007/09/19_14:53:31 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting crmd[7228]: 2007/09/19_14:53:31 ERROR: ghash_print_pending: Pending action: IPaddr_10_0_0_59:22 crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource drbdlinks_5 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource IPaddr_10_0_0_59 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource msg_1 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource daemontools_2 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource drbddisk_3 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: verify_stopped: Resource Filesystem_4 was active at shutdown. You may ignore this error if it is unmanaged. crmd[7228]: 2007/09/19_14:53:31 ERROR: do_exit: Performing A_EXIT_1 - forcefully exiting the CRMd crmd[7228]: 2007/09/19_14:53:31 ERROR: do_exit: Could not recover from internal error crmd[7228]: 2007/09/19_14:53:31 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[7228]: 2007/09/19_14:53:31 info: do_exit: [crmd] stopped (2) heartbeat[13166]: 2007/09/19_14:54:44 info: No log entry found in ha.cf -- use logd heartbeat[13166]: 2007/09/19_14:54:44 info: Enabling logging daemon heartbeat[13166]: 2007/09/19_14:54:44 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[13166]: 2007/09/19_14:54:44 info: ************************** heartbeat[13166]: 2007/09/19_14:54:44 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[13167]: 2007/09/19_14:54:44 info: heartbeat: version 2.1.2 heartbeat[13167]: 2007/09/19_14:54:44 info: Heartbeat generation: 1188360841 heartbeat[13167]: 2007/09/19_14:54:44 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13167]: 2007/09/19_14:54:44 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13167]: 2007/09/19_14:54:44 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[13167]: 2007/09/19_14:54:44 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[13167]: 2007/09/19_14:54:44 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[13167]: 2007/09/19_14:54:44 info: glib: ping group heartbeat started. heartbeat[13167]: 2007/09/19_14:54:44 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[13167]: 2007/09/19_14:54:44 info: Local status now set to: 'up' heartbeat[13167]: 2007/09/19_14:54:46 info: Link local:local up. heartbeat[13167]: 2007/09/19_14:54:46 info: Status update for node local: status ping heartbeat[13167]: 2007/09/19_14:54:46 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[13167]: 2007/09/19_14:56:44 WARN: node host-2.awale.qc.ca: is dead heartbeat[13167]: 2007/09/19_14:56:44 info: Comm_now_up(): updating status to active heartbeat[13167]: 2007/09/19_14:56:44 info: Local status now set to: 'active' heartbeat[13167]: 2007/09/19_14:56:44 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[13167]: 2007/09/19_14:56:44 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[13202]: 2007/09/19_14:56:44 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 13202) heartbeat[13167]: 2007/09/19_14:56:44 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[13167]: 2007/09/19_14:56:45 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[13167]: 2007/09/19_14:56:45 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[13167]: 2007/09/19_14:56:45 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[13167]: 2007/09/19_14:56:45 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[13167]: 2007/09/19_14:56:45 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[13203]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 13203) cibmon[13202]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[13206]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 13206) heartbeat[13204]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 13204) heartbeat[13207]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 13207) heartbeat[13205]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 13205) heartbeat[13208]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 13208) cib[13204]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13204]: 2007/09/19_14:56:45 info: G_main_add_TriggerHandler: Added signal manual handler cib[13204]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[13204]: 2007/09/19_14:56:45 info: main: Retrieval of a per-action CIB: disabled cib[13204]: 2007/09/19_14:56:45 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[13204]: 2007/09/19_14:56:45 ERROR: validate_cib_digest: Digest comparision failed: b0bd065a7f0f483ebcca8d305c7f7985 vs. 35e1d5b159b1ac6cda4f899bdc24d17f cib[13204]: 2007/09/19_14:56:45 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[13204]: 2007/09/19_14:56:45 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. cib[13204]: 2007/09/19_14:56:45 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.13204 cib[13204]: 2007/09/19_14:56:45 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.13204 cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[13204]: 2007/09/19_14:56:45 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[13204]: 2007/09/19_14:56:45 ERROR: validate_cib_digest: Digest comparision failed: b0bd065a7f0f483ebcca8d305c7f7985 vs. 35e1d5b159b1ac6cda4f899bdc24d17f cib[13204]: 2007/09/19_14:56:45 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml.last failed! Configuration contents ignored! cib[13204]: 2007/09/19_14:56:45 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml.last will NOT used. cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: Continuing with an empty configuration. cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: No value for admin_epoch was specified in the configuration. cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: The reccomended course of action is to shutdown, run crm_verify and fix any errors it reports. cib[13204]: 2007/09/19_14:56:45 WARN: readCibXmlFile: We will default to zero and continue but may get confused about which configuration to use if multiple nodes are powered up at the same time. cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 info: log_data_element: readCibXmlFile: [on-disk] cib[13204]: 2007/09/19_14:56:45 notice: readCibXmlFile: Enabling DTD validation on the existing (sane) configuration cib[13204]: 2007/09/19_14:56:45 info: startCib: CIB Initialization completed successfully cib[13204]: 2007/09/19_14:56:45 info: cib_register_ha: Signing in with Heartbeat ccm[13203]: 2007/09/19_14:56:45 info: Hostname: host-1.awale.qc.ca attrd[13207]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13204]: 2007/09/19_14:56:45 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[13204]: 2007/09/19_14:56:45 WARN: cib_init: CCM Activation failed cib[13204]: 2007/09/19_14:56:45 WARN: cib_init: CCM Connection failed 1 times (30 max) attrd[13207]: 2007/09/19_14:56:45 info: register_with_ha: Hostname: host-1.awale.qc.ca heartbeat[13209]: 2007/09/19_14:56:45 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 13209) lrmd[7225]: 2007/09/19_14:56:45 info: lrmd is shutting down lrmd[13205]: 2007/09/19_14:56:45 info: Signal sent to pid=7225, waiting for process to exit lrmd[13205]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[13205]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[13205]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[13205]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[13205]: 2007/09/19_14:56:45 info: Started. crmd[13208]: 2007/09/19_14:56:45 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[13208]: 2007/09/19_14:56:45 info: crmd_init: Starting crmd crmd[13208]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[13208]: 2007/09/19_14:56:45 info: G_main_add_TriggerHandler: Added signal manual handler crmd[13208]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 17 stonithd[13206]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[13206]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[13207]: 2007/09/19_14:56:45 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 stonithd[13206]: 2007/09/19_14:56:45 info: Signing in with heartbeat. mgmtd[13209]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[13209]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[13209]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[13206]: 2007/09/19_14:56:45 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[13206]: 2007/09/19_14:56:45 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[13209]: 2007/09/19_14:56:45 info: init_crm cib[13204]: 2007/09/19_14:56:46 WARN: cib_init: CCM Activation failed cib[13204]: 2007/09/19_14:56:46 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[13203]: 2007/09/19_14:56:46 info: Break tie for 2 nodes cluster ccm[13203]: 2007/09/19_14:56:46 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13204]: 2007/09/19_14:56:47 info: cib_init: Starting cib mainloop cib[13204]: 2007/09/19_14:56:47 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[13204]: 2007/09/19_14:56:47 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[13204]: 2007/09/19_14:56:47 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[13208]: 2007/09/19_14:56:47 info: do_cib_control: CIB connection established crmd[13208]: 2007/09/19_14:56:47 info: register_with_ha: Hostname: host-1.awale.qc.ca cibmon[13202]: 2007/09/19_14:56:47 info: main: Starting mainloop cib[13204]: 2007/09/19_14:56:47 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[13204]: 2007/09/19_14:56:47 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[13204]: 2007/09/19_14:56:47 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[13204]: 2007/09/19_14:56:47 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[13204]: 2007/09/19_14:56:47 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[13210]: 2007/09/19_14:56:47 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 5089cad33cdd64199b9dec26e83cdb50) crmd[13208]: 2007/09/19_14:56:48 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[13208]: 2007/09/19_14:56:48 info: populate_cib_nodes: Requesting the list of configured nodes crmd[13208]: 2007/09/19_14:56:50 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[13208]: 2007/09/19_14:56:50 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[13208]: 2007/09/19_14:56:50 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[13208]: 2007/09/19_14:56:50 info: do_ha_control: Connected to Heartbeat crmd[13208]: 2007/09/19_14:56:50 info: do_ccm_control: CCM connection established... waiting for first callback crmd[13208]: 2007/09/19_14:56:50 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[13208]: 2007/09/19_14:56:50 info: crmd_init: Starting crmd's mainloop crmd[13208]: 2007/09/19_14:56:50 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[13202]: 2007/09/19_14:56:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13202]: 2007/09/19_14:56:50 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cib[13211]: 2007/09/19_14:56:50 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 2022f1b1010606fe58e179d2bc892b74) crmd[13208]: 2007/09/19_14:56:50 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[13208]: 2007/09/19_14:56:50 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[13208]: 2007/09/19_14:56:50 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[13208]: 2007/09/19_14:56:50 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13208]: 2007/09/19_14:56:50 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[13208]: 2007/09/19_14:56:50 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[13208]: 2007/09/19_14:56:50 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[13208]: 2007/09/19_14:56:50 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[13208]: 2007/09/19_14:56:50 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[13208]: 2007/09/19_14:56:50 info: do_started: The local CRM is operational crmd[13208]: 2007/09/19_14:56:50 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[13208]: 2007/09/19_14:56:50 info: update_dc: Set DC to () cibmon[13202]: 2007/09/19_14:56:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13202]: 2007/09/19_14:56:50 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13202]: 2007/09/19_14:56:50 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + cibmon[13202]: 2007/09/19_14:56:50 info: log_data_element: cib_update: + mgmtd[13209]: 2007/09/19_14:56:51 info: Started. attrd[13207]: 2007/09/19_14:56:52 info: main: Starting mainloop... heartbeat[13167]: 2007/09/19_14:57:55 info: killing /usr/lib/heartbeat/mgmtd -v process group 13209 with signal 15 mgmtd[13209]: 2007/09/19_14:57:55 info: mgmtd is shutting down heartbeat[13167]: 2007/09/19_14:57:55 info: killing /usr/lib/heartbeat/crmd process group 13208 with signal 15 crmd[13208]: 2007/09/19_14:57:55 info: crm_shutdown: Requesting shutdown crmd[13208]: 2007/09/19_14:57:55 info: do_shutdown_req: Sending shutdown request to DC: heartbeat[13167]: 2007/09/19_14:58:48 info: Core process 13170 exited. 5 remaining heartbeat[13167]: 2007/09/19_14:58:48 info: Core process 13174 exited. 4 remaining heartbeat[13167]: 2007/09/19_14:58:48 info: Core process 13171 exited. 3 remaining heartbeat[13167]: 2007/09/19_14:58:48 info: Core process 13173 exited. 2 remaining heartbeat[13167]: 2007/09/19_14:58:48 info: Core process 13172 exited. 1 remaining heartbeat[13167]: 2007/09/19_14:58:48 info: host-1.awale.qc.ca Heartbeat shutdown complete. ccm[13203]: 2007/09/19_14:58:48 ERROR: Lost connection to heartbeat service. Need to bail out. cib[13204]: 2007/09/19_14:58:48 info: mem_handle_func:IPC broken, ccm is dead before the client! cib[13204]: 2007/09/19_14:58:48 ERROR: cib_ccm_dispatch: CCM connection appears to have failed: rc=-1. crmd[13208]: 2007/09/19_14:58:48 info: mem_handle_func:IPC broken, ccm is dead before the client! crmd[13208]: 2007/09/19_14:58:48 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1. crmd[13208]: 2007/09/19_14:58:48 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_PENDING) crmd[13208]: 2007/09/19_14:58:48 info: do_state_transition: State transition S_PENDING -> S_RECOVERY [ input=I_ERROR cause=C_CCM_CALLBACK origin=ccm_dispatch ] cib[13204]: 2007/09/19_14:58:48 ERROR: cib_ha_connection_destroy: Heartbeat connection lost! Exiting. crmd[13208]: 2007/09/19_14:58:48 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported cib[13204]: 2007/09/19_14:58:48 ERROR: crm_abort: main: Triggered non-fatal assert at main.c:213 : g_hash_table_size(client_list) == 0 attrd[13207]: 2007/09/19_14:58:48 CRIT: attrd_ha_dispatch: Lost connection to heartbeat service. crmd[13208]: 2007/09/19_14:58:48 ERROR: do_log: [[FSA]] Input I_STOP from do_recover() received in state (S_RECOVERY) cib[13204]: 2007/09/19_14:58:48 WARN: main: Not all clients gone at exit attrd[13207]: 2007/09/19_14:58:48 CRIT: attrd_ha_connection_destroy: Lost connection to heartbeat service! crmd[13208]: 2007/09/19_14:58:48 info: do_state_transition: State transition S_RECOVERY -> S_STOPPING [ input=I_STOP cause=C_FSA_INTERNAL origin=do_recover ] stonithd[13206]: 2007/09/19_14:58:48 ERROR: Disconnected with heartbeat daemon attrd[13207]: 2007/09/19_14:58:48 info: main: Exiting... crmd[13208]: 2007/09/19_14:58:48 info: do_dc_release: DC role released stonithd[13206]: 2007/09/19_14:58:48 notice: /usr/lib/heartbeat/stonithd normally quit. crmd[13208]: 2007/09/19_14:58:48 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[13208]: 2007/09/19_14:58:48 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[13208]: 2007/09/19_14:58:48 info: verify_stopped: Checking for active resources before exit crmd[13208]: 2007/09/19_14:58:48 info: verify_stopped: Checking for active resources before exit crmd[13208]: 2007/09/19_14:58:48 info: do_lrm_control: Disconnected from the LRM crmd[13208]: 2007/09/19_14:58:48 info: do_ha_control: Disconnected from Heartbeat crmd[13208]: 2007/09/19_14:58:48 info: do_cib_control: Disconnecting CIB crmd[13208]: 2007/09/19_14:58:48 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[13208]: 2007/09/19_14:58:48 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[13208]: 2007/09/19_14:58:48 ERROR: do_exit: Could not recover from internal error crmd[13208]: 2007/09/19_14:58:48 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13208]: 2007/09/19_14:58:48 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13208]: 2007/09/19_14:58:48 info: do_exit: [crmd] stopped (2) cibmon[13202]: 2007/09/19_14:58:48 info: cib_native_msgready: Lost connection to the CIB service [13204]. cibmon[13202]: 2007/09/19_14:58:48 CRIT: cib_native_dispatch: Lost connection to the CIB service [13204/callback]. cibmon[13202]: 2007/09/19_14:58:48 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting heartbeat[13311]: 2007/09/19_14:59:39 info: No log entry found in ha.cf -- use logd heartbeat[13311]: 2007/09/19_14:59:39 info: Enabling logging daemon heartbeat[13311]: 2007/09/19_14:59:39 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[13311]: 2007/09/19_14:59:39 info: ************************** heartbeat[13311]: 2007/09/19_14:59:39 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[13312]: 2007/09/19_14:59:39 info: heartbeat: version 2.1.2 heartbeat[13312]: 2007/09/19_14:59:39 info: Heartbeat generation: 1188360842 heartbeat[13312]: 2007/09/19_14:59:39 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13312]: 2007/09/19_14:59:39 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13312]: 2007/09/19_14:59:39 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[13312]: 2007/09/19_14:59:39 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[13312]: 2007/09/19_14:59:39 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[13312]: 2007/09/19_14:59:39 info: glib: ping group heartbeat started. heartbeat[13312]: 2007/09/19_14:59:39 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[13312]: 2007/09/19_14:59:40 info: Local status now set to: 'up' heartbeat[13312]: 2007/09/19_14:59:41 info: Link local:local up. heartbeat[13312]: 2007/09/19_14:59:41 info: Status update for node local: status ping heartbeat[13312]: 2007/09/19_14:59:41 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[13312]: 2007/09/19_15:01:40 WARN: node host-2.awale.qc.ca: is dead heartbeat[13312]: 2007/09/19_15:01:40 info: Comm_now_up(): updating status to active heartbeat[13312]: 2007/09/19_15:01:40 info: Local status now set to: 'active' heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[13331]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 13331) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[13312]: 2007/09/19_15:01:40 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[13332]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 13332) heartbeat[13334]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 13334) heartbeat[13335]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 13335) cibmon[13331]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[13336]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 13336) heartbeat[13338]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 13338) heartbeat[13337]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 13337) heartbeat[13333]: 2007/09/19_15:01:40 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 13333) lrmd[13205]: 2007/09/19_15:01:40 info: lrmd is shutting down crmd[13337]: 2007/09/19_15:01:40 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[13337]: 2007/09/19_15:01:40 info: crmd_init: Starting crmd crmd[13337]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[13337]: 2007/09/19_15:01:40 info: G_main_add_TriggerHandler: Added signal manual handler crmd[13337]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[13334]: 2007/09/19_15:01:40 info: Signal sent to pid=13205, waiting for process to exit lrmd[13334]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[13334]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[13333]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13333]: 2007/09/19_15:01:40 info: G_main_add_TriggerHandler: Added signal manual handler cib[13333]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[13333]: 2007/09/19_15:01:40 info: main: Retrieval of a per-action CIB: disabled cib[13333]: 2007/09/19_15:01:40 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml lrmd[13334]: 2007/09/19_15:01:40 info: G_main_add_SignalHandler: Added signal handler for signal 10 cib[13333]: 2007/09/19_15:01:40 WARN: validate_cib_digest: No on-disk digest present cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:40 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13333]: 2007/09/19_15:01:41 info: log_data_element: readCibXmlFile: [on-disk] lrmd[13334]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[13334]: 2007/09/19_15:01:41 info: Started. cib[13333]: 2007/09/19_15:01:41 info: startCib: CIB Initialization completed successfully cib[13333]: 2007/09/19_15:01:41 info: cib_register_ha: Signing in with Heartbeat ccm[13332]: 2007/09/19_15:01:41 info: Hostname: host-1.awale.qc.ca stonithd[13335]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[13335]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[13333]: 2007/09/19_15:01:41 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[13333]: 2007/09/19_15:01:41 WARN: cib_init: CCM Activation failed cib[13333]: 2007/09/19_15:01:41 WARN: cib_init: CCM Connection failed 1 times (30 max) mgmtd[13338]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[13335]: 2007/09/19_15:01:41 info: Signing in with heartbeat. mgmtd[13338]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[13338]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[13338]: 2007/09/19_15:01:41 info: init_crm stonithd[13335]: 2007/09/19_15:01:41 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[13335]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[13336]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[13336]: 2007/09/19_15:01:41 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[13336]: 2007/09/19_15:01:41 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 ccm[13332]: 2007/09/19_15:01:41 info: Break tie for 2 nodes cluster ccm[13332]: 2007/09/19_15:01:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13333]: 2007/09/19_15:01:42 info: cib_init: Starting cib mainloop cib[13333]: 2007/09/19_15:01:42 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[13333]: 2007/09/19_15:01:42 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[13333]: 2007/09/19_15:01:42 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cib[13339]: 2007/09/19_15:01:42 WARN: validate_cib_digest: No on-disk digest present cibmon[13331]: 2007/09/19_15:01:42 info: main: Starting mainloop crmd[13337]: 2007/09/19_15:01:42 info: do_cib_control: CIB connection established crmd[13337]: 2007/09/19_15:01:42 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[13333]: 2007/09/19_15:01:42 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[13333]: 2007/09/19_15:01:42 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[13333]: 2007/09/19_15:01:42 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[13333]: 2007/09/19_15:01:42 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[13333]: 2007/09/19_15:01:42 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[13339]: 2007/09/19_15:01:42 info: write_cib_contents: Wrote version 0.1.1 of the CIB to disk (digest: 05517b99c75b7069334464e9e0671fcc) crmd[13337]: 2007/09/19_15:01:42 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[13337]: 2007/09/19_15:01:43 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[13338]: 2007/09/19_15:01:44 info: Started. crmd[13337]: 2007/09/19_15:01:44 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[13337]: 2007/09/19_15:01:44 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[13337]: 2007/09/19_15:01:44 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[13337]: 2007/09/19_15:01:44 info: do_ha_control: Connected to Heartbeat crmd[13337]: 2007/09/19_15:01:44 info: do_ccm_control: CCM connection established... waiting for first callback crmd[13337]: 2007/09/19_15:01:44 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[13337]: 2007/09/19_15:01:44 info: crmd_init: Starting crmd's mainloop crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[13337]: 2007/09/19_15:01:44 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[13337]: 2007/09/19_15:01:44 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[13337]: 2007/09/19_15:01:44 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[13331]: 2007/09/19_15:01:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:01:44 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 cibmon[13331]: 2007/09/19_15:01:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:44 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:01:45 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13337]: 2007/09/19_15:01:45 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[13337]: 2007/09/19_15:01:45 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[13337]: 2007/09/19_15:01:45 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[13337]: 2007/09/19_15:01:45 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[13337]: 2007/09/19_15:01:45 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[13337]: 2007/09/19_15:01:45 info: do_started: The local CRM is operational crmd[13337]: 2007/09/19_15:01:45 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[13337]: 2007/09/19_15:01:45 info: update_dc: Set DC to () cibmon[13331]: 2007/09/19_15:01:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:01:45 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 cibmon[13331]: 2007/09/19_15:01:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:01:45 info: log_data_element: cib_update: + attrd[13336]: 2007/09/19_15:01:47 info: main: Starting mainloop... crmd[13337]: 2007/09/19_15:03:46 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[13337]: 2007/09/19_15:03:46 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[13337]: 2007/09/19_15:03:46 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[13337]: 2007/09/19_15:03:46 info: update_dc: Set DC to () crmd[13337]: 2007/09/19_15:03:46 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[13337]: 2007/09/19_15:03:46 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[13337]: 2007/09/19_15:03:46 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[13337]: 2007/09/19_15:03:46 info: start_subsystem: Starting sub-system "tengine" crmd[13337]: 2007/09/19_15:03:46 info: start_subsystem: Starting sub-system "pengine" crmd[13337]: 2007/09/19_15:03:46 info: do_dc_takeover: Taking over DC status for this partition cib[13333]: 2007/09/19_15:03:46 info: cib_process_readwrite: We are now in R/W mode crmd[13337]: 2007/09/19_15:03:46 info: update_dc: Set DC to () crmd[13337]: 2007/09/19_15:03:46 info: join_make_offer: Making join offers based on membership 1 crmd[13337]: 2007/09/19_15:03:46 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cibmon[13331]: 2007/09/19_15:03:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: --- 0.1.1 cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: +++ 0.1.2 cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:46 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[13365]: 2007/09/19_15:03:46 info: G_main_add_TriggerHandler: Added signal manual handler cib[13333]: 2007/09/19_15:03:46 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[13365]: 2007/09/19_15:03:46 info: te_init: Registering TE UUID: 87e05e6a-fd71-483a-8ef1-283835d18fea tengine[13365]: 2007/09/19_15:03:46 info: set_graph_functions: Setting custom graph functions tengine[13365]: 2007/09/19_15:03:46 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[13365]: 2007/09/19_15:03:46 info: te_init: Starting tengine pengine[13366]: 2007/09/19_15:03:46 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[13366]: 2007/09/19_15:03:46 info: pe_init: Starting pengine crmd[13337]: 2007/09/19_15:03:46 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13337]: 2007/09/19_15:03:46 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[13337]: 2007/09/19_15:03:46 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[13337]: 2007/09/19_15:03:46 info: update_attrd: Connecting to attrd... attrd[13336]: 2007/09/19_15:03:46 info: attrd_local_callback: Sending full refresh cib[13333]: 2007/09/19_15:03:46 info: sync_our_cib: Syncing CIB to all peers cibmon[13331]: 2007/09/19_15:03:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: --- 0.1.2 cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: +++ 0.1.3 cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: --- 0.1.3 cibmon[13331]: 2007/09/19_15:03:46 info: log_cib_diff: cib_update: Diff: +++ 0.1.4 cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:46 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:47 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13337]: 2007/09/19_15:03:47 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:03:47 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[13331]: 2007/09/19_15:03:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[13337]: 2007/09/19_15:03:47 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[13331]: 2007/09/19_15:03:47 info: log_cib_diff: cib_update: Diff: --- 0.1.4 cibmon[13331]: 2007/09/19_15:03:47 info: log_cib_diff: cib_update: Diff: +++ 0.1.5 tengine[13365]: 2007/09/19_15:03:47 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:03:47 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:47 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:03:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:03:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:03:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:03:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:03:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:03:47 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:03:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[13366]: 2007/09/19_15:03:47 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:03:47 info: native_print: msg_first (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: drbd-share (heartbeat:drbddisk): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: mysql (lsb:mysql): Stopped pengine[13366]: 2007/09/19_15:03:47 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start drbd-share pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca drbd-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start Filesystem-share pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca Filesystem-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start drbdlinks-share pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca drbdlinks-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[13366]: 2007/09/19_15:03:47 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[13366]: 2007/09/19_15:03:47 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-31.bz2 crmd[13337]: 2007/09/19_15:03:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:03:47 info: unpack_graph: Unpacked transition 0: 28 actions in 28 synapses tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 3: msg_first_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 4: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 5: drbd-share_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 6: Filesystem-share_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 7: drbdlinks-share_monitor_0 on host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:03:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=3:0:87e05e6a-fd71-483a-8ef1-283835d18fea) tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 8: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 9: mysql_monitor_0 on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:47 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:03:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=4:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:47 info: do_lrm_rsc_op: Performing op=drbd-share_monitor_0 key=5:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: do_lrm_rsc_op: Performing op=Filesystem-share_monitor_0 key=6:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: do_lrm_rsc_op: Performing op=drbdlinks-share_monitor_0 key=7:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=8:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=9:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=10:0:87e05e6a-fd71-483a-8ef1-283835d18fea) crmd[13337]: 2007/09/19_15:03:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=0) complete cibmon[13331]: 2007/09/19_15:03:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:03:48 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: --- 0.1.5 tengine[13365]: 2007/09/19_15:03:48 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 0): Error cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.6 tengine[13365]: 2007/09/19_15:03:48 info: update_abort_priority: Abort priority upgraded to 1 cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:03:48 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:48 info: match_graph_event: Action vmstat-mon_monitor_0 (4) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:48 info: process_lrm_event: LRM operation drbd-share_monitor_0 (call=4, rc=0) complete cibmon[13331]: 2007/09/19_15:03:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:03:48 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: --- 0.1.6 tengine[13365]: 2007/09/19_15:03:48 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 0): Error cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.7 tengine[13365]: 2007/09/19_15:03:48 info: match_graph_event: Action drbd-share_monitor_0 (5) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete cibmon[13331]: 2007/09/19_15:03:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:03:48 info: match_graph_event: Action msg_first_monitor_0 (3) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: --- 0.1.7 cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.8 cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:48 info: process_lrm_event: LRM operation Filesystem-share_monitor_0 (call=5, rc=0) complete cibmon[13331]: 2007/09/19_15:03:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:03:48 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: --- 0.1.8 tengine[13365]: 2007/09/19_15:03:48 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 0): Error cibmon[13331]: 2007/09/19_15:03:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.9 tengine[13365]: 2007/09/19_15:03:48 info: match_graph_event: Action Filesystem-share_monitor_0 (6) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:48 info: log_data_element: cib_update: + lrmd[13431]: 2007/09/19_15:03:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[13337]: 2007/09/19_15:03:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=8, rc=254) Error cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:03:49 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 254): Error cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: --- 0.1.9 tengine[13365]: 2007/09/19_15:03:49 info: match_graph_event: Action mysql_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: +++ 0.1.10 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: process_lrm_event: LRM operation drbdlinks-share_monitor_0 (call=6, rc=0) complete cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: --- 0.1.10 cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: +++ 0.1.11 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 tengine[13365]: 2007/09/19_15:03:49 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 0): Error tengine[13365]: 2007/09/19_15:03:49 info: match_graph_event: Action drbdlinks-share_monitor_0 (7) confirmed on host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:03:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=0) complete cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: --- 0.1.11 cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: +++ 0.1.12 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: 7 vs. rc: 0): Error cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (8) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: --- 0.1.12 cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: +++ 0.1.13 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:03:49 info: match_graph_event: Action msg_last_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 info: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:03:49 notice: run_graph: Transition 0: (Complete=8, Pending=0, Fired=0, Skipped=19, Incomplete=1) cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:03:49 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:03:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[13366]: 2007/09/19_15:03:49 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:03:49 info: native_print: msg_first (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:03:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca FAILED pengine[13366]: 2007/09/19_15:03:49 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:03:49 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Leave resource drbd-share (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca drbd-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Leave resource Filesystem-share (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca Filesystem-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Leave resource drbdlinks-share (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca drbdlinks-share_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[13366]: 2007/09/19_15:03:49 notice: NoRoleChange: Recover resource mysql (host-1.awale.qc.ca) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop mysql crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:03:49 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[13366]: 2007/09/19_15:03:49 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[13366]: 2007/09/19_15:03:49 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-32.bz2 tengine[13365]: 2007/09/19_15:03:49 info: unpack_graph: Unpacked transition 1: 23 actions in 23 synapses tengine[13365]: 2007/09/19_15:03:49 info: te_pseudo_action: Pseudo action 27 fired and confirmed tengine[13365]: 2007/09/19_15:03:49 info: te_pseudo_action: Pseudo action 30 fired and confirmed tengine[13365]: 2007/09/19_15:03:49 info: send_rsc_command: Initiating action 3: probe_complete on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:49 info: send_rsc_command: Initiating action 1: mysql_stop_0 on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_modify: Diff: --- 0.1.13 cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_modify: Diff: +++ 0.1.14 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: - cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + tengine[13365]: 2007/09/19_15:03:49 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + tengine[13365]: 2007/09/19_15:03:49 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + tengine[13365]: 2007/09/19_15:03:49 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + crmd[13337]: 2007/09/19_15:03:49 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=1:1:87e05e6a-fd71-483a-8ef1-283835d18fea) cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_modify: + lrmd[13464]: 2007/09/19_15:03:49 WARN: For LSB init script, no additional parameters are needed. lrmd[13464]: 2007/09/19_15:03:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[13337]: 2007/09/19_15:03:49 ERROR: process_lrm_event: LRM operation mysql_stop_0 (call=10, rc=254) Error cibmon[13331]: 2007/09/19_15:03:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: --- 0.1.14 cibmon[13331]: 2007/09/19_15:03:49 info: log_cib_diff: cib_update: Diff: +++ 0.1.15 tengine[13365]: 2007/09/19_15:03:49 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:03:49 info: match_graph_event: Action mysql_stop_0 (1) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:03:49 info: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:03:49 notice: run_graph: Transition 1: (Complete=4, Pending=0, Fired=0, Skipped=19, Incomplete=0) cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:03:49 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:03:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:03:49 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:03:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[13366]: 2007/09/19_15:03:49 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:03:49 info: native_print: msg_first (heartbeat:msg): Stopped crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:03:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:03:49 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:49 info: unpack_graph: Unpacked transition 2: 8 actions in 8 synapses pengine[13366]: 2007/09/19_15:03:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:03:49 info: te_pseudo_action: Pseudo action 11 fired and confirmed pengine[13366]: 2007/09/19_15:03:49 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[13365]: 2007/09/19_15:03:49 info: te_pseudo_action: Pseudo action 21 fired and confirmed pengine[13366]: 2007/09/19_15:03:49 info: native_print: msg_last (heartbeat:msg): Stopped tengine[13365]: 2007/09/19_15:03:49 notice: run_graph: ==================================================== pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource msg_first cannot run anywhere crmd[13337]: 2007/09/19_15:03:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:03:49 WARN: run_graph: Transition 2: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 ERROR: te_graph_trigger: Transition failed: terminated pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource drbd-share cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource Filesystem-share cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource drbdlinks-share cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 12]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource mysql cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 4]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: native_color: Resource msg_last cannot run anywhere tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 5]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 6]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 7]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 8]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[13366]: 2007/09/19_15:03:49 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 21]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: should_dump_action: action 8 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: should_dump_action: action 8 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 4]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[13366]: 2007/09/19_15:03:49 WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-13.bz2 tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[13366]: 2007/09/19_15:03:49 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 4]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 5]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 5]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 6]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 6]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 7]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: [Action 7]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 8]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_elem: * [Input 11]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[13365]: 2007/09/19_15:03:49 WARN: print_graph: Synapse 7 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:03:49 info: notify_crmd: Transition 2 status: te_complete - heartbeat[13312]: 2007/09/19_15:04:32 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[13312]: 2007/09/19_15:04:32 info: Status update for node host-2.awale.qc.ca: status init heartbeat[13312]: 2007/09/19_15:04:32 info: Status update for node host-2.awale.qc.ca: status up crmd[13337]: 2007/09/19_15:04:32 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] crmd[13337]: 2007/09/19_15:04:32 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[13312]: 2007/09/19_15:04:32 info: all clients are now paused heartbeat[13312]: 2007/09/19_15:04:32 info: all clients are now resumed heartbeat[13312]: 2007/09/19_15:04:33 info: Status update for node host-2.awale.qc.ca: status active crmd[13337]: 2007/09/19_15:04:33 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] cib[13333]: 2007/09/19_15:04:33 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] cibmon[13331]: 2007/09/19_15:04:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:33 info: log_cib_diff: cib_update: Local-only Change: 0.1.15 cibmon[13331]: 2007/09/19_15:04:33 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:33 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:33 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:33 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:33 info: log_data_element: cib_update: + heartbeat[13312]: 2007/09/19_15:04:35 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [11:13] crmd[13337]: 2007/09/19_15:04:35 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] heartbeat[13312]: 2007/09/19_15:04:35 info: No pkts missing from host-2.awale.qc.ca! heartbeat[13312]: 2007/09/19_15:04:35 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [16:18] heartbeat[13312]: 2007/09/19_15:04:35 info: No pkts missing from host-2.awale.qc.ca! cibmon[13331]: 2007/09/19_15:04:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:35 info: log_cib_diff: cib_update: Local-only Change: 0.1.15 cibmon[13331]: 2007/09/19_15:04:35 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:35 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:35 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:35 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:35 info: log_data_element: cib_update: + cib[13333]: 2007/09/19_15:04:36 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[13337]: 2007/09/19_15:04:36 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[13333]: 2007/09/19_15:04:36 info: mem_handle_event: no mbr_track info crmd[13337]: 2007/09/19_15:04:36 info: mem_handle_event: no mbr_track info cib[13333]: 2007/09/19_15:04:36 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13337]: 2007/09/19_15:04:36 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[13333]: 2007/09/19_15:04:36 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[13337]: 2007/09/19_15:04:36 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[13333]: 2007/09/19_15:04:36 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:04:36 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) cib[13333]: 2007/09/19_15:04:36 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[13337]: 2007/09/19_15:04:36 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[13337]: 2007/09/19_15:04:36 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[13337]: 2007/09/19_15:04:36 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=2] crmd[13337]: 2007/09/19_15:04:36 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[13331]: 2007/09/19_15:04:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:36 info: log_cib_diff: cib_update: Local-only Change: 0.1.15 cibmon[13331]: 2007/09/19_15:04:36 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:36 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:36 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:36 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:36 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:39 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:04:39 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[13337]: 2007/09/19_15:04:39 info: update_dc: Set DC to () crmd[13337]: 2007/09/19_15:04:39 info: join_make_offer: Making join offers based on membership 2 crmd[13337]: 2007/09/19_15:04:39 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks crmd[13337]: 2007/09/19_15:04:39 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13337]: 2007/09/19_15:04:40 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[13337]: 2007/09/19_15:04:40 info: do_state_transition: All 2 cluster nodes responded to the join offer. cib[13333]: 2007/09/19_15:04:40 info: sync_our_cib: Syncing CIB to all peers attrd[13336]: 2007/09/19_15:04:40 info: attrd_local_callback: Sending full refresh cibmon[13331]: 2007/09/19_15:04:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: --- 0.1.15 cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: +++ 0.1.16 cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: --- 0.1.16 cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: +++ 0.1.17 cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: --- 0.1.17 cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: +++ 0.1.18 cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:40 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13337]: 2007/09/19_15:04:40 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:04:40 info: process_graph_event: Detected action msg_first_monitor_0 from a different transition: 0 vs. 2 tengine[13365]: 2007/09/19_15:04:40 info: process_graph_event: Detected action msg_last_monitor_0 from a different transition: 0 vs. 2 cibmon[13331]: 2007/09/19_15:04:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: --- 0.1.18 cibmon[13331]: 2007/09/19_15:04:40 info: log_cib_diff: cib_update: Diff: +++ 0.1.19 cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:40 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:41 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:41 info: log_cib_diff: cib_update: Diff: --- 0.1.19 crmd[13337]: 2007/09/19_15:04:41 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[13331]: 2007/09/19_15:04:41 info: log_cib_diff: cib_update: Diff: +++ 0.1.20 crmd[13337]: 2007/09/19_15:04:41 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:41 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:04:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:04:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:04:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:04:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:04:41 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:04:41 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[13366]: 2007/09/19_15:04:41 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[13366]: 2007/09/19_15:04:41 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:04:41 info: native_print: msg_first (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:41 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:41 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[13366]: 2007/09/19_15:04:41 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:41 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Move resource drbd-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Move resource Filesystem-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Move resource drbdlinks-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[13366]: 2007/09/19_15:04:41 notice: NoRoleChange: Recover resource mysql (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:41 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:41 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start mysql crmd[13337]: 2007/09/19_15:04:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:04:41 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[13366]: 2007/09/19_15:04:41 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[13366]: 2007/09/19_15:04:41 WARN: should_dump_action: action 29 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:41 WARN: should_dump_action: action 30 (mysql_start_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:41 WARN: should_dump_action: action 29 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:41 WARN: should_dump_action: action 30 (mysql_start_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:41 WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-14.bz2 pengine[13366]: 2007/09/19_15:04:41 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[13365]: 2007/09/19_15:04:41 info: unpack_graph: Unpacked transition 3: 34 actions in 34 synapses tengine[13365]: 2007/09/19_15:04:41 info: te_pseudo_action: Pseudo action 35 fired and confirmed tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 3: msg_first_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 4: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 5: drbd-share_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 6: Filesystem-share_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 7: drbdlinks-share_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 8: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 9: mysql_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:04:41 info: te_pseudo_action: Pseudo action 38 fired and confirmed cibmon[13331]: 2007/09/19_15:04:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: --- 0.1.20 cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: +++ 0.1.21 cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:42 info: match_graph_event: Action vmstat-mon_monitor_0 (4) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: --- 0.1.21 tengine[13365]: 2007/09/19_15:04:42 info: match_graph_event: Action drbd-share_monitor_0 (5) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: +++ 0.1.22 cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:42 info: match_graph_event: Action msg_first_monitor_0 (3) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: --- 0.1.22 cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: +++ 0.1.23 cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:42 info: match_graph_event: Action Filesystem-share_monitor_0 (6) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: --- 0.1.23 cibmon[13331]: 2007/09/19_15:04:42 info: log_cib_diff: cib_update: Diff: +++ 0.1.24 cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:42 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: --- 0.1.24 cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: +++ 0.1.25 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:04:43 WARN: status_from_rc: Action monitor on host-2.awale.qc.ca failed (target: 7 vs. rc: 254): Error cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:43 info: update_abort_priority: Abort priority upgraded to 1 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:43 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:43 info: match_graph_event: Action mysql_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:43 info: match_graph_event: Action drbdlinks-share_monitor_0 (7) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: --- 0.1.25 cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: +++ 0.1.26 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:43 info: match_graph_event: Action msg_last_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: --- 0.1.26 cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: +++ 0.1.27 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:04:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (8) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:04:43 info: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[13365]: 2007/09/19_15:04:43 notice: run_graph: Transition 3: (Complete=10, Pending=0, Fired=0, Skipped=23, Incomplete=1) cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: --- 0.1.27 cibmon[13331]: 2007/09/19_15:04:43 info: log_cib_diff: cib_update: Diff: +++ 0.1.28 cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:43 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:43 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[13366]: 2007/09/19_15:04:43 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_add_running: resource mysql isnt managed pengine[13366]: 2007/09/19_15:04:43 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:43 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:04:43 info: native_print: msg_first (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:04:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:04:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: mysql (lsb:mysql) pengine[13366]: 2007/09/19_15:04:43 info: native_print: 0 : host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: 1 : host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[13366]: 2007/09/19_15:04:43 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:43 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[13366]: 2007/09/19_15:04:43 notice: NoRoleChange: Move resource drbd-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:43 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:43 notice: NoRoleChange: Move resource Filesystem-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:43 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:43 notice: NoRoleChange: Move resource drbdlinks-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:43 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:43 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:04:43 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[13366]: 2007/09/19_15:04:43 ERROR: native_create_actions: Attempting recovery of resource mysql pengine[13366]: 2007/09/19_15:04:43 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:43 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:43 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[13365]: 2007/09/19_15:04:43 info: unpack_graph: Unpacked transition 4: 25 actions in 25 synapses pengine[13366]: 2007/09/19_15:04:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[13365]: 2007/09/19_15:04:43 info: te_pseudo_action: Pseudo action 28 fired and confirmed pengine[13366]: 2007/09/19_15:04:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[13365]: 2007/09/19_15:04:43 info: send_rsc_command: Initiating action 19: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 WARN: should_dump_action: action 23 (mysql_start_0) was for an unmanaged resource (mysql) crmd[13337]: 2007/09/19_15:04:43 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=19:4:87e05e6a-fd71-483a-8ef1-283835d18fea) tengine[13365]: 2007/09/19_15:04:43 info: te_pseudo_action: Pseudo action 31 fired and confirmed pengine[13366]: 2007/09/19_15:04:43 WARN: should_dump_action: action 23 (mysql_start_0) was for an unmanaged resource (mysql) tengine[13365]: 2007/09/19_15:04:43 info: send_rsc_command: Initiating action 3: probe_complete on host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:43 ERROR: process_pe_message: Transition 4: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-0.bz2 pengine[13366]: 2007/09/19_15:04:43 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. lrmd[13334]: 2007/09/19_15:04:44 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[13334]: 2007/09/19_15:04:44 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[13492][13507]: 2007/09/19_15:04:44 INFO: ifconfig eth0:0 down crmd[13337]: 2007/09/19_15:04:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=11, rc=0) complete cibmon[13331]: 2007/09/19_15:04:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:44 info: log_cib_diff: cib_update: Diff: --- 0.1.28 tengine[13365]: 2007/09/19_15:04:44 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (19) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:44 info: log_cib_diff: cib_update: Diff: +++ 0.1.29 tengine[13365]: 2007/09/19_15:04:44 info: send_rsc_command: Initiating action 16: drbdlinks-share_stop_0 on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: - crmd[13337]: 2007/09/19_15:04:44 info: do_lrm_rsc_op: Performing op=drbdlinks-share_stop_0 key=16:4:87e05e6a-fd71-483a-8ef1-283835d18fea) cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:44 info: process_lrm_event: LRM operation drbdlinks-share_stop_0 (call=12, rc=0) complete cibmon[13331]: 2007/09/19_15:04:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:44 info: log_cib_diff: cib_update: Diff: --- 0.1.29 cibmon[13331]: 2007/09/19_15:04:44 info: log_cib_diff: cib_update: Diff: +++ 0.1.30 cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:44 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:44 info: match_graph_event: Action drbdlinks-share_stop_0 (16) confirmed on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:04:44 info: send_rsc_command: Initiating action 13: Filesystem-share_stop_0 on host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:04:44 info: do_lrm_rsc_op: Performing op=Filesystem-share_stop_0 key=13:4:87e05e6a-fd71-483a-8ef1-283835d18fea) Filesystem[13516][13545]: 2007/09/19_15:04:44 INFO: Running stop for /dev/drbd0 on /share Filesystem[13516][13555]: 2007/09/19_15:04:45 INFO: Trying to unmount /share Filesystem[13516][13557]: 2007/09/19_15:04:45 INFO: unmounted /share successfully crmd[13337]: 2007/09/19_15:04:45 info: process_lrm_event: LRM operation Filesystem-share_stop_0 (call=13, rc=0) complete cibmon[13331]: 2007/09/19_15:04:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:45 info: match_graph_event: Action Filesystem-share_stop_0 (13) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: --- 0.1.30 tengine[13365]: 2007/09/19_15:04:45 info: send_rsc_command: Initiating action 10: drbd-share_stop_0 on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: +++ 0.1.31 cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:45 info: do_lrm_rsc_op: Performing op=drbd-share_stop_0 key=10:4:87e05e6a-fd71-483a-8ef1-283835d18fea) cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:45 info: process_lrm_event: LRM operation drbd-share_stop_0 (call=14, rc=0) complete cibmon[13331]: 2007/09/19_15:04:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: --- 0.1.31 tengine[13365]: 2007/09/19_15:04:45 info: match_graph_event: Action drbd-share_stop_0 (10) confirmed on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: +++ 0.1.32 tengine[13365]: 2007/09/19_15:04:45 info: send_rsc_command: Initiating action 7: vmstat-mon_stop_0 on host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=7:4:87e05e6a-fd71-483a-8ef1-283835d18fea) cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[13365]: 2007/09/19_15:04:45 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_modify: Diff: --- 0.1.32 tengine[13365]: 2007/09/19_15:04:45 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_modify: Diff: +++ 0.1.33 tengine[13365]: 2007/09/19_15:04:45 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: - cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_modify: + daemontools[13565][13574]: 2007/09/19_15:04:45 INFO Stoping vmstat-mon crmd[13337]: 2007/09/19_15:04:45 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=15, rc=0) complete tengine[13365]: 2007/09/19_15:04:45 info: match_graph_event: Action vmstat-mon_stop_0 (7) confirmed on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:04:45 info: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:04:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:45 notice: run_graph: Transition 4: (Complete=8, Pending=0, Fired=0, Skipped=17, Incomplete=0) cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: --- 0.1.33 cibmon[13331]: 2007/09/19_15:04:45 info: log_cib_diff: cib_update: Diff: +++ 0.1.34 cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:04:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:45 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:04:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:04:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:04:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:04:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:04:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:04:45 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:04:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[13366]: 2007/09/19_15:04:45 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[13366]: 2007/09/19_15:04:45 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 info: native_add_running: resource mysql isnt managed pengine[13366]: 2007/09/19_15:04:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:45 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:04:45 info: native_print: msg_first (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:45 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[13366]: 2007/09/19_15:04:45 info: native_print: drbd-share (heartbeat:drbddisk): Stopped pengine[13366]: 2007/09/19_15:04:45 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Stopped crmd[13337]: 2007/09/19_15:04:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:04:45 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Stopped pengine[13366]: 2007/09/19_15:04:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[13366]: 2007/09/19_15:04:45 info: native_print: mysql (lsb:mysql) pengine[13366]: 2007/09/19_15:04:45 info: native_print: 0 : host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 info: native_print: 1 : host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 tengine[13365]: 2007/09/19_15:04:45 info: unpack_graph: Unpacked transition 5: 16 actions in 16 synapses pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon tengine[13365]: 2007/09/19_15:04:45 info: te_pseudo_action: Pseudo action 21 fired and confirmed pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 tengine[13365]: 2007/09/19_15:04:45 info: send_rsc_command: Initiating action 5: msg_first_start_0 on host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[13366]: 2007/09/19_15:04:45 ERROR: native_create_actions: Attempting recovery of resource mysql pengine[13366]: 2007/09/19_15:04:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:45 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[13366]: 2007/09/19_15:04:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[13366]: 2007/09/19_15:04:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[13366]: 2007/09/19_15:04:45 WARN: should_dump_action: action 18 (mysql_start_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:45 WARN: should_dump_action: action 18 (mysql_start_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:04:45 ERROR: process_pe_message: Transition 5: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-1.bz2 pengine[13366]: 2007/09/19_15:04:45 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[13331]: 2007/09/19_15:04:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:47 info: match_graph_event: Action msg_first_start_0 (5) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:47 info: log_cib_diff: cib_update: Diff: --- 0.1.34 tengine[13365]: 2007/09/19_15:04:47 info: send_rsc_command: Initiating action 6: msg_first_monitor_120000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:47 info: log_cib_diff: cib_update: Diff: +++ 0.1.35 tengine[13365]: 2007/09/19_15:04:47 info: send_rsc_command: Initiating action 7: vmstat-mon_start_0 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:47 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:48 info: match_graph_event: Action msg_first_monitor_120000 (6) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:48 info: log_cib_diff: cib_update: Diff: --- 0.1.35 cibmon[13331]: 2007/09/19_15:04:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.36 cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:48 info: match_graph_event: Action vmstat-mon_start_0 (7) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:48 info: send_rsc_command: Initiating action 8: vmstat-mon_monitor_120000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:48 info: send_rsc_command: Initiating action 9: drbd-share_start_0 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:48 info: log_cib_diff: cib_update: Diff: --- 0.1.36 cibmon[13331]: 2007/09/19_15:04:48 info: log_cib_diff: cib_update: Diff: +++ 0.1.37 cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:48 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:51 info: log_cib_diff: cib_update: Diff: --- 0.1.37 cibmon[13331]: 2007/09/19_15:04:51 info: log_cib_diff: cib_update: Diff: +++ 0.1.38 cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:51 info: match_graph_event: Action drbd-share_start_0 (9) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:51 info: send_rsc_command: Initiating action 10: drbd-share_monitor_120000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:51 info: send_rsc_command: Initiating action 11: Filesystem-share_start_0 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:51 info: log_cib_diff: cib_update: Diff: --- 0.1.38 cibmon[13331]: 2007/09/19_15:04:51 info: log_cib_diff: cib_update: Diff: +++ 0.1.39 cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:51 info: match_graph_event: Action vmstat-mon_monitor_120000 (8) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:51 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:52 info: match_graph_event: Action drbd-share_monitor_120000 (10) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:52 info: log_cib_diff: cib_update: Diff: --- 0.1.39 cibmon[13331]: 2007/09/19_15:04:52 info: log_cib_diff: cib_update: Diff: +++ 0.1.40 cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:52 info: match_graph_event: Action Filesystem-share_start_0 (11) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:52 info: send_rsc_command: Initiating action 12: Filesystem-share_monitor_120000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:52 info: send_rsc_command: Initiating action 13: drbdlinks-share_start_0 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:52 info: log_cib_diff: cib_update: Diff: --- 0.1.40 cibmon[13331]: 2007/09/19_15:04:52 info: log_cib_diff: cib_update: Diff: +++ 0.1.41 cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:52 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:54 info: log_cib_diff: cib_update: Diff: --- 0.1.41 cibmon[13331]: 2007/09/19_15:04:54 info: log_cib_diff: cib_update: Diff: +++ 0.1.42 cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:54 info: match_graph_event: Action drbdlinks-share_start_0 (13) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:54 info: send_rsc_command: Initiating action 14: drbdlinks-share_monitor_120000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:54 info: send_rsc_command: Initiating action 15: IPaddr_10_0_0_59_start_0 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:54 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:55 info: log_cib_diff: cib_update: Diff: --- 0.1.42 tengine[13365]: 2007/09/19_15:04:55 info: match_graph_event: Action Filesystem-share_monitor_120000 (12) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:55 info: log_cib_diff: cib_update: Diff: +++ 0.1.43 cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:55 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:56 info: log_cib_diff: cib_update: Diff: --- 0.1.43 cibmon[13331]: 2007/09/19_15:04:56 info: log_cib_diff: cib_update: Diff: +++ 0.1.44 cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:56 info: match_graph_event: Action drbdlinks-share_monitor_120000 (14) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:04:56 info: log_cib_diff: cib_update: Diff: --- 0.1.44 cibmon[13331]: 2007/09/19_15:04:56 info: log_cib_diff: cib_update: Diff: +++ 0.1.45 cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:56 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (15) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:56 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_5000 on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:56 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:04:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:04:57 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (16) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:04:57 info: log_cib_diff: cib_update: Diff: --- 0.1.45 tengine[13365]: 2007/09/19_15:04:57 notice: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:04:57 info: log_cib_diff: cib_update: Diff: +++ 0.1.46 tengine[13365]: 2007/09/19_15:04:57 WARN: run_graph: Transition 5: (Complete=13, Pending=0, Fired=0, Skipped=0, Incomplete=3) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: - crmd[13337]: 2007/09/19_15:04:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[13365]: 2007/09/19_15:04:57 ERROR: te_graph_trigger: Transition failed: terminated cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 0 was confirmed (priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 1 is pending (priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: [Action 22]: Pending (id: group-DW_running_0, type: pseduo, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 5]: Completed (id: msg_first_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 7]: Completed (id: vmstat-mon_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 9]: Completed (id: drbd-share_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 11]: Completed (id: Filesystem-share_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 13]: Completed (id: drbdlinks-share_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 15]: Completed (id: IPaddr_10_0_0_59_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 18]: Pending (id: mysql_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 19]: Pending (id: msg_last_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 21]: Completed (id: group-DW_start_0, type: pseduo, priority: 0) cibmon[13331]: 2007/09/19_15:04:57 info: log_data_element: cib_update: + tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 2 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 3 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 4 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 5 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 6 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 7 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 9 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 10 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 11 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 12 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 13 was confirmed (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 14 is pending (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: [Action 19]: Pending (id: msg_last_start_0, loc: host-2.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 18]: Pending (id: mysql_start_0, loc: host-2.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_graph: Synapse 15 is pending (priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: [Action 20]: Pending (id: msg_last_monitor_120000, loc: host-2.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:04:57 WARN: print_elem: * [Input 19]: Pending (id: msg_last_start_0, loc: host-2.awale.qc.ca, priority: 0) tengine[13365]: 2007/09/19_15:04:57 info: notify_crmd: Transition 5 status: te_complete - heartbeat[13312]: 2007/09/19_15:07:19 info: killing /usr/lib/heartbeat/mgmtd -v process group 13338 with signal 15 mgmtd[13338]: 2007/09/19_15:07:19 info: mgmtd is shutting down heartbeat[13312]: 2007/09/19_15:07:19 info: killing /usr/lib/heartbeat/crmd process group 13337 with signal 15 crmd[13337]: 2007/09/19_15:07:19 info: crm_shutdown: Requesting shutdown crmd[13337]: 2007/09/19_15:07:19 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] crmd[13337]: 2007/09/19_15:07:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown_req: Processing shutdown locally crmd[13337]: 2007/09/19_15:07:19 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca cibmon[13331]: 2007/09/19_15:07:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13331]: 2007/09/19_15:07:19 info: log_cib_diff: cib_update: Diff: --- 0.1.46 cibmon[13331]: 2007/09/19_15:07:19 info: log_cib_diff: cib_update: Diff: +++ 0.1.47 tengine[13365]: 2007/09/19_15:07:19 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:07:19 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:19 info: log_data_element: cib_update: + pengine[13366]: 2007/09/19_15:07:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[13366]: 2007/09/19_15:07:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[13366]: 2007/09/19_15:07:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[13366]: 2007/09/19_15:07:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[13366]: 2007/09/19_15:07:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[13366]: 2007/09/19_15:07:19 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[13366]: 2007/09/19_15:07:19 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[13366]: 2007/09/19_15:07:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[13366]: 2007/09/19_15:07:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_add_running: resource mysql isnt managed pengine[13366]: 2007/09/19_15:07:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:07:19 info: group_print: Resource Group: group-DW pengine[13366]: 2007/09/19_15:07:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: drbd-share (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: mysql (lsb:mysql) pengine[13366]: 2007/09/19_15:07:19 info: native_print: 0 : host-1.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: 1 : host-2.awale.qc.ca pengine[13366]: 2007/09/19_15:07:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource vmstat-mon (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource drbd-share (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource Filesystem-share (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource drbdlinks-share (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[13366]: 2007/09/19_15:07:19 ERROR: native_create_actions: Attempting recovery of resource mysql pengine[13366]: 2007/09/19_15:07:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:07:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[13366]: 2007/09/19_15:07:19 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[13366]: 2007/09/19_15:07:19 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[13366]: 2007/09/19_15:07:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[13366]: 2007/09/19_15:07:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 crmd[13337]: 2007/09/19_15:07:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[13366]: 2007/09/19_15:07:19 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[13366]: 2007/09/19_15:07:19 WARN: should_dump_action: action 24 (mysql_start_0) was for an unmanaged resource (mysql) pengine[13366]: 2007/09/19_15:07:19 WARN: should_dump_action: action 24 (mysql_start_0) was for an unmanaged resource (mysql) tengine[13365]: 2007/09/19_15:07:19 info: unpack_graph: Unpacked transition 6: 17 actions in 17 synapses tengine[13365]: 2007/09/19_15:07:19 info: te_pseudo_action: Pseudo action 27 fired and confirmed tengine[13365]: 2007/09/19_15:07:19 info: send_rsc_command: Initiating action 12: msg_first_start_0 on host-2.awale.qc.ca tengine[13365]: 2007/09/19_15:07:19 info: te_crm_command: Executing crm-event (31): do_shutdown on host-1.awale.qc.ca tengine[13365]: 2007/09/19_15:07:19 info: te_crm_command: Skipping wait for 31 crmd[13337]: 2007/09/19_15:07:19 info: handle_request: Shutting ourselves down (DC) crmd[13337]: 2007/09/19_15:07:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ] crmd[13337]: 2007/09/19_15:07:19 info: do_dc_release: DC role released tengine[13365]: 2007/09/19_15:07:19 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to pengine: [13366] tengine[13365]: 2007/09/19_15:07:19 info: update_abort_priority: Abort action 0 superceeded by 3 crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to tengine: [13365] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the pengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to pengine: [13366] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the tengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to tengine: [13365] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Waiting for subsystems to exit crmd[13337]: 2007/09/19_15:07:19 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[13337]: 2007/09/19_15:07:19 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the pengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to pengine: [13366] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the tengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to tengine: [13365] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Waiting for subsystems to exit pengine[13366]: 2007/09/19_15:07:19 ERROR: process_pe_message: Transition 6: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-2.bz2 pengine[13366]: 2007/09/19_15:07:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. pengine[13366]: 2007/09/19_15:07:19 info: pengine_shutdown: Exiting PEngine (SIGTERM) crmd[13337]: 2007/09/19_15:07:19 info: process_client_disconnect: Received HUP from pengine:[13366] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the pengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to pengine: [13366] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the tengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to tengine: [13365] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Waiting for subsystems to exit crmd[13337]: 2007/09/19_15:07:19 info: crmdManagedChildDied: Process pengine:[13366] exited (signal=0, exitcode=0) crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Terminating the tengine crmd[13337]: 2007/09/19_15:07:19 info: stop_subsystem: Sent -TERM to tengine: [13365] crmd[13337]: 2007/09/19_15:07:19 info: do_shutdown: Waiting for subsystems to exit cibmon[13331]: 2007/09/19_15:07:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[13365]: 2007/09/19_15:07:21 info: match_graph_event: Action msg_first_start_0 (12) confirmed on host-2.awale.qc.ca cibmon[13331]: 2007/09/19_15:07:21 info: log_cib_diff: cib_update: Diff: --- 0.1.47 tengine[13365]: 2007/09/19_15:07:21 info: run_graph: ==================================================== cibmon[13331]: 2007/09/19_15:07:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.48 tengine[13365]: 2007/09/19_15:07:21 notice: run_graph: Transition 6: (Complete=3, Pending=0, Fired=0, Skipped=14, Incomplete=0) cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:07:21 info: notify_crmd: Exiting after transition cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - tengine[13365]: 2007/09/19_15:07:21 info: te_init: Exiting tengine cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: - cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:07:21 info: process_client_disconnect: Received HUP from tengine:[13365] cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:07:21 info: do_shutdown: Terminating the tengine cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:07:21 info: stop_subsystem: Sent -TERM to tengine: [13365] cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:07:21 info: do_shutdown: Waiting for subsystems to exit cibmon[13331]: 2007/09/19_15:07:21 info: log_data_element: cib_update: + crmd[13337]: 2007/09/19_15:07:21 info: crmdManagedChildDied: Process tengine:[13365] exited (signal=0, exitcode=0) crmd[13337]: 2007/09/19_15:07:21 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[13337]: 2007/09/19_15:07:21 info: verify_stopped: Checking for active resources before exit crmd[13337]: 2007/09/19_15:07:21 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. ccm[13332]: 2007/09/19_15:07:21 info: client (pid=13337) removed from ccm crmd[13337]: 2007/09/19_15:07:21 info: verify_stopped: Checking for active resources before exit crmd[13337]: 2007/09/19_15:07:21 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. crmd[13337]: 2007/09/19_15:07:21 info: do_lrm_control: Disconnected from the LRM crmd[13337]: 2007/09/19_15:07:21 info: do_ha_control: Disconnected from Heartbeat crmd[13337]: 2007/09/19_15:07:21 info: do_cib_control: Disconnecting CIB crmd[13337]: 2007/09/19_15:07:21 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[13337]: 2007/09/19_15:07:21 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[13337]: 2007/09/19_15:07:21 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13337]: 2007/09/19_15:07:21 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13337]: 2007/09/19_15:07:21 info: do_exit: [crmd] stopped (0) cib[13333]: 2007/09/19_15:07:21 info: cib_process_readwrite: We are now in R/O mode cib[13333]: 2007/09/19_15:07:21 WARN: send_via_callback_channel: Cannot find client for token 8cd3bc21-9e9f-4486-b265-0ccbc6ef0d81 cib[13333]: 2007/09/19_15:07:21 WARN: do_local_notify: A-Sync reply to 13337 failed: client left before we could send reply heartbeat[13312]: 2007/09/19_15:07:21 info: killing /usr/lib/heartbeat/attrd process group 13336 with signal 15 attrd[13336]: 2007/09/19_15:07:21 info: attrd_shutdown: Exiting attrd[13336]: 2007/09/19_15:07:21 info: main: Exiting... heartbeat[13312]: 2007/09/19_15:07:21 info: killing /usr/lib/heartbeat/stonithd process group 13335 with signal 15 stonithd[13335]: 2007/09/19_15:07:21 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[13312]: 2007/09/19_15:07:21 info: killing /usr/lib/heartbeat/lrmd -r process group 13334 with signal 15 lrmd[13334]: 2007/09/19_15:07:21 info: lrmd is shutting down heartbeat[13312]: 2007/09/19_15:07:21 info: killing /usr/lib/heartbeat/cib process group 13333 with signal 15 cib[13333]: 2007/09/19_15:07:21 WARN: disconnect_cib_client: Disconnecting /cib_ro... cibmon[13331]: 2007/09/19_15:07:21 ERROR: cib_native_msgready: Message pending on command channel [13333] cib[13333]: 2007/09/19_15:07:21 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[13331]: 2007/09/19_15:07:21 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cibmon[13331]: 2007/09/19_15:07:21 ERROR: MSG: No message to dump cibmon[13331]: 2007/09/19_15:07:21 info: cib_native_msgready: Lost connection to the CIB service [13333]. cibmon[13331]: 2007/09/19_15:07:21 CRIT: cib_native_dispatch: Lost connection to the CIB service [13333/callback]. cibmon[13331]: 2007/09/19_15:07:21 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[13333]: 2007/09/19_15:07:21 info: cib_shutdown: Disconnected 2 clients cib[13333]: 2007/09/19_15:07:21 info: cib_process_disconnect: All clients disconnected... cib[13333]: 2007/09/19_15:07:21 info: initiate_exit: Sending disconnect notification to 2 peers... cib[13333]: 2007/09/19_15:07:22 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[13333]: 2007/09/19_15:07:22 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[13333]: 2007/09/19_15:07:22 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[13333]: 2007/09/19_15:07:22 info: main: Done ccm[13332]: 2007/09/19_15:07:22 info: client (pid=13333) removed from ccm heartbeat[13312]: 2007/09/19_15:07:22 info: killing /usr/lib/heartbeat/ccm process group 13332 with signal 15 ccm[13332]: 2007/09/19_15:07:22 info: received SIGTERM, going to shut down heartbeat[13312]: 2007/09/19_15:07:22 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[13312]: 2007/09/19_15:07:23 info: killing HBFIFO process 13316 with signal 15 heartbeat[13312]: 2007/09/19_15:07:23 info: killing HBWRITE process 13317 with signal 15 heartbeat[13312]: 2007/09/19_15:07:23 info: killing HBREAD process 13318 with signal 15 heartbeat[13312]: 2007/09/19_15:07:23 info: killing HBWRITE process 13319 with signal 15 heartbeat[13312]: 2007/09/19_15:07:23 info: killing HBREAD process 13320 with signal 15 heartbeat[13312]: 2007/09/19_15:07:23 info: Core process 13317 exited. 5 remaining heartbeat[13312]: 2007/09/19_15:07:23 info: Core process 13316 exited. 4 remaining heartbeat[13312]: 2007/09/19_15:07:23 info: Core process 13319 exited. 3 remaining heartbeat[13312]: 2007/09/19_15:07:23 info: Core process 13318 exited. 2 remaining heartbeat[13312]: 2007/09/19_15:07:23 info: Core process 13320 exited. 1 remaining heartbeat[13312]: 2007/09/19_15:07:23 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[7164]: 2007/09/19_15:07:24 info: logd_term_write_action: received SIGTERM logd[7164]: 2007/09/19_15:07:24 info: Exiting write process logd[13674]: 2007/09/19_15:11:39 info: logd started with /etc/logd.cf. logd[13674]: 2007/09/19_15:11:39 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[13677]: 2007/09/19_15:11:39 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[13695]: 2007/09/19_15:11:39 info: No log entry found in ha.cf -- use logd heartbeat[13695]: 2007/09/19_15:11:39 info: Enabling logging daemon heartbeat[13695]: 2007/09/19_15:11:39 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[13695]: 2007/09/19_15:11:39 info: ************************** heartbeat[13695]: 2007/09/19_15:11:39 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[13696]: 2007/09/19_15:11:39 info: heartbeat: version 2.1.2 heartbeat[13696]: 2007/09/19_15:11:39 info: Heartbeat generation: 1188360843 heartbeat[13696]: 2007/09/19_15:11:39 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13696]: 2007/09/19_15:11:39 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[13696]: 2007/09/19_15:11:39 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[13696]: 2007/09/19_15:11:39 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[13696]: 2007/09/19_15:11:39 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[13696]: 2007/09/19_15:11:39 info: glib: ping group heartbeat started. heartbeat[13696]: 2007/09/19_15:11:39 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[13696]: 2007/09/19_15:11:39 info: Local status now set to: 'up' heartbeat[13696]: 2007/09/19_15:11:40 info: Link local:local up. heartbeat[13696]: 2007/09/19_15:11:40 info: Status update for node local: status ping heartbeat[13696]: 2007/09/19_15:11:40 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[13696]: 2007/09/19_15:11:40 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[13696]: 2007/09/19_15:11:41 info: Comm_now_up(): updating status to active heartbeat[13696]: 2007/09/19_15:11:41 info: Local status now set to: 'active' heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[13707]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 13707) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[13696]: 2007/09/19_15:11:41 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[13696]: 2007/09/19_15:11:41 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 80 ms (> 50 ms) (GSource: 0x9d50110) heartbeat[13696]: 2007/09/19_15:11:41 info: Status update for node host-2.awale.qc.ca: status active heartbeat[13708]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 13708) heartbeat[13710]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 13710) cibmon[13707]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[13711]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 13711) heartbeat[13713]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 13713) heartbeat[13712]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 13712) heartbeat[13714]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 13714) heartbeat[13709]: 2007/09/19_15:11:41 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 13709) lrmd[13710]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[13710]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[13710]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[13710]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[13710]: 2007/09/19_15:11:41 info: Started. cib[13709]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13709]: 2007/09/19_15:11:41 info: G_main_add_TriggerHandler: Added signal manual handler cib[13709]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[13709]: 2007/09/19_15:11:41 info: main: Retrieval of a per-action CIB: disabled cib[13709]: 2007/09/19_15:11:41 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml attrd[13712]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 ccm[13708]: 2007/09/19_15:11:41 info: Hostname: host-1.awale.qc.ca cib[13709]: 2007/09/19_15:11:41 ERROR: validate_cib_digest: Digest comparision failed: 05517b99c75b7069334464e9e0671fcc vs. 76006ffdacd1e97a134595b0aa187f37 cib[13709]: 2007/09/19_15:11:41 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[13709]: 2007/09/19_15:11:41 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[13709]: 2007/09/19_15:11:41 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. cib[13709]: 2007/09/19_15:11:41 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.13709 cib[13709]: 2007/09/19_15:11:41 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.13709 cib[13709]: 2007/09/19_15:11:41 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[13709]: 2007/09/19_15:11:41 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[13709]: 2007/09/19_15:11:41 WARN: validate_cib_digest: No on-disk digest present cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: log_data_element: readCibXmlFile: [on-disk] cib[13709]: 2007/09/19_15:11:41 info: startCib: CIB Initialization completed successfully cib[13709]: 2007/09/19_15:11:41 info: cib_register_ha: Signing in with Heartbeat cib[13709]: 2007/09/19_15:11:41 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[13709]: 2007/09/19_15:11:41 WARN: cib_init: CCM Activation failed cib[13709]: 2007/09/19_15:11:41 WARN: cib_init: CCM Connection failed 1 times (30 max) attrd[13712]: 2007/09/19_15:11:41 info: register_with_ha: Hostname: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:11:41 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[13713]: 2007/09/19_15:11:41 info: crmd_init: Starting crmd crmd[13713]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[13713]: 2007/09/19_15:11:41 info: G_main_add_TriggerHandler: Added signal manual handler crmd[13713]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 17 stonithd[13711]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[13711]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[13714]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[13714]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[13714]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[13712]: 2007/09/19_15:11:41 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[13714]: 2007/09/19_15:11:41 info: init_crm stonithd[13711]: 2007/09/19_15:11:41 info: Signing in with heartbeat. stonithd[13711]: 2007/09/19_15:11:41 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[13711]: 2007/09/19_15:11:41 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[13709]: 2007/09/19_15:11:42 WARN: cib_init: CCM Activation failed cib[13709]: 2007/09/19_15:11:42 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[13708]: 2007/09/19_15:11:43 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13709]: 2007/09/19_15:11:43 info: cib_init: Starting cib mainloop crmd[13713]: 2007/09/19_15:11:43 info: do_cib_control: CIB connection established cib[13709]: 2007/09/19_15:11:43 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[13709]: 2007/09/19_15:11:43 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cibmon[13707]: 2007/09/19_15:11:43 info: main: Starting mainloop cib[13709]: 2007/09/19_15:11:43 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[13713]: 2007/09/19_15:11:43 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[13709]: 2007/09/19_15:11:43 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[13709]: 2007/09/19_15:11:43 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[13715]: 2007/09/19_15:11:43 info: write_cib_contents: Wrote version 0.1.1 of the CIB to disk (digest: 77929a379f9e5f7eb7836782ae059ab6) cib[13709]: 2007/09/19_15:11:44 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[13713]: 2007/09/19_15:11:44 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[13713]: 2007/09/19_15:11:44 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[13714]: 2007/09/19_15:11:45 info: Started. crmd[13713]: 2007/09/19_15:11:45 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[13713]: 2007/09/19_15:11:45 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[13713]: 2007/09/19_15:11:45 info: do_ha_control: Connected to Heartbeat crmd[13713]: 2007/09/19_15:11:45 info: do_ccm_control: CCM connection established... waiting for first callback crmd[13713]: 2007/09/19_15:11:45 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[13713]: 2007/09/19_15:11:45 info: crmd_init: Starting crmd's mainloop crmd[13713]: 2007/09/19_15:11:45 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[13713]: 2007/09/19_15:11:46 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[13707]: 2007/09/19_15:11:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:11:46 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 cibmon[13707]: 2007/09/19_15:11:46 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:46 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:46 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:46 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:46 info: log_data_element: cib_update: + cib[13709]: 2007/09/19_15:11:46 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13713]: 2007/09/19_15:11:46 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cib[13709]: 2007/09/19_15:11:46 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[13709]: 2007/09/19_15:11:46 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cib[13709]: 2007/09/19_15:11:46 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:11:47 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[13713]: 2007/09/19_15:11:47 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[13713]: 2007/09/19_15:11:47 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13713]: 2007/09/19_15:11:47 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[13713]: 2007/09/19_15:11:47 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=4) crmd[13713]: 2007/09/19_15:11:47 info: ccm_event_detail: NEW MEMBERSHIP: trans=4, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 crmd[13713]: 2007/09/19_15:11:47 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[13707]: 2007/09/19_15:11:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[13713]: 2007/09/19_15:11:47 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=4] cibmon[13707]: 2007/09/19_15:11:47 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 crmd[13713]: 2007/09/19_15:11:47 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:11:47 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=4] cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:11:47 info: do_started: The local CRM is operational cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:11:47 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:11:47 info: update_dc: Set DC to () cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:11:47 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:11:47 info: log_data_element: cib_update: + attrd[13712]: 2007/09/19_15:11:48 info: main: Starting mainloop... crmd[13713]: 2007/09/19_15:11:49 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[13713]: 2007/09/19_15:11:50 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[13713]: 2007/09/19_15:11:50 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[13709]: 2007/09/19_15:11:50 info: cib_replace_notify: Replaced: 0.1.1 -> 0.1.53 from crmd[13713]: 2007/09/19_15:11:50 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[13707]: 2007/09/19_15:11:50 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[13707]: 2007/09/19_15:11:50 info: log_cib_diff: cib_replace: Diff: --- 0.1.1 cibmon[13707]: 2007/09/19_15:11:50 info: log_cib_diff: cib_replace: Diff: +++ 0.1.53 cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cib[13720]: 2007/09/19_15:11:51 info: write_cib_contents: Wrote version 0.1.56 of the CIB to disk (digest: 9a8f51102608d400601a55341ae25cb7) cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_replace: + cibmon[13707]: 2007/09/19_15:11:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.53 cibmon[13707]: 2007/09/19_15:11:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.54 cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:50 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.54 cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.55 cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.55 cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.56 cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.56 cibmon[13707]: 2007/09/19_15:11:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.57 cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:51 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:11:51 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[13713]: 2007/09/19_15:11:52 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:3:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:3:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:11:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.57 cibmon[13707]: 2007/09/19_15:11:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.58 crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=drbd-share_monitor_0 key=11:3:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=Filesystem-share_monitor_0 key=12:3:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:52 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=drbdlinks-share_monitor_0 key=13:3:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:3:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:3:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:11:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:3:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:11:52 info: process_lrm_event: LRM operation drbd-share_monitor_0 (call=4, rc=7) complete crmd[13713]: 2007/09/19_15:11:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete crmd[13713]: 2007/09/19_15:11:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[13713]: 2007/09/19_15:11:53 info: process_lrm_event: LRM operation Filesystem-share_monitor_0 (call=5, rc=7) complete lrmd[13786]: 2007/09/19_15:11:53 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[13713]: 2007/09/19_15:11:53 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=8, rc=254) Error crmd[13713]: 2007/09/19_15:11:53 info: process_lrm_event: LRM operation drbdlinks-share_monitor_0 (call=6, rc=7) complete cibmon[13707]: 2007/09/19_15:11:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.58 cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.59 cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.59 cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.60 cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.60 cibmon[13707]: 2007/09/19_15:11:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.61 cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:53 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:11:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete crmd[13713]: 2007/09/19_15:11:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.61 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.62 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.62 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.63 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.63 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.64 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.64 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.65 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.65 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.66 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.66 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.67 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.67 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.68 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.68 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.69 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.69 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.70 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.70 cibmon[13707]: 2007/09/19_15:11:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.71 cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:55 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.71 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.72 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.72 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.73 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.73 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.74 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:11:56 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=11:4:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.74 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.75 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.75 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.76 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.76 cibmon[13707]: 2007/09/19_15:11:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.77 cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:56 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.77 cibmon[13707]: 2007/09/19_15:11:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.78 cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + msg[13817][13838]: 2007/09/19_15:11:57 INFO Starting to switch to this node. msg[13817][13839]: 2007/09/19_15:11:57 INFO Node: host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:11:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.78 cibmon[13707]: 2007/09/19_15:11:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.79 cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:57 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:11:57 info: process_lrm_event: LRM operation msg_first_start_0 (call=10, rc=0) complete crmd[13713]: 2007/09/19_15:11:57 info: build_operation_update: Digest for 0:0;11:4:f9a72663-35e0-4964-ac99-7be9d3dba335 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[13713]: 2007/09/19_15:11:57 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:11:58 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=6:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:11:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:11:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.79 cibmon[13707]: 2007/09/19_15:11:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.80 cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:11:58 info: log_data_element: cib_apply_diff: + msg[13849][13870]: 2007/09/19_15:11:59 INFO Starting to switch to this node. msg[13849][13871]: 2007/09/19_15:11:59 INFO Node: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:11:59 info: process_lrm_event: LRM operation msg_first_start_0 (call=11, rc=0) complete crmd[13713]: 2007/09/19_15:11:59 info: build_operation_update: Digest for 0:0;6:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[13713]: 2007/09/19_15:11:59 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:12:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=7:5:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:12:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=8:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.80 cibmon[13707]: 2007/09/19_15:12:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.81 cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:00 info: log_data_element: cib_apply_diff: + daemontools[13882][13906]: 2007/09/19_15:12:00 INFO Starting vmstat-mon crmd[13713]: 2007/09/19_15:12:00 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=12, rc=0) complete crmd[13713]: 2007/09/19_15:12:00 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=13, rc=0) complete crmd[13713]: 2007/09/19_15:12:00 info: build_operation_update: Digest for 0:0;8:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[13713]: 2007/09/19_15:12:00 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:12:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=9:5:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:12:01 info: do_lrm_rsc_op: Performing op=drbd-share_start_0 key=10:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.81 cibmon[13707]: 2007/09/19_15:12:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.82 cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:01 info: process_lrm_event: LRM operation drbd-share_start_0 (call=15, rc=0) complete cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:01 info: build_operation_update: Digest for 0:0;10:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbd-share_start_0) was eaef18223bea84e8b011465368d9f74e crmd[13713]: 2007/09/19_15:12:01 info: log_data_element: build_operation_update: digest:source cibmon[13707]: 2007/09/19_15:12:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.82 cibmon[13707]: 2007/09/19_15:12:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.83 cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:01 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=14, rc=0) complete crmd[13713]: 2007/09/19_15:12:02 info: do_lrm_rsc_op: Performing op=drbd-share_monitor_120000 key=11:5:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:12:02 info: do_lrm_rsc_op: Performing op=Filesystem-share_start_0 key=12:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.83 cibmon[13707]: 2007/09/19_15:12:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.84 cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:02 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.84 cibmon[13707]: 2007/09/19_15:12:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.85 cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:03 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:03 info: process_lrm_event: LRM operation drbd-share_monitor_120000 (call=16, rc=0) complete Filesystem[13928][13960]: 2007/09/19_15:12:03 INFO: Running start for /dev/drbd0 on /share crmd[13713]: 2007/09/19_15:12:03 info: process_lrm_event: LRM operation Filesystem-share_start_0 (call=17, rc=0) complete crmd[13713]: 2007/09/19_15:12:03 info: build_operation_update: Digest for 0:0;12:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (Filesystem-share_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[13713]: 2007/09/19_15:12:03 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:12:04 info: do_lrm_rsc_op: Performing op=Filesystem-share_monitor_120000 key=13:5:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:12:04 info: do_lrm_rsc_op: Performing op=drbdlinks-share_start_0 key=14:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.85 cibmon[13707]: 2007/09/19_15:12:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.86 cibmon[13707]: 2007/09/19_15:12:04 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:04 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:04 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:04 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.86 cibmon[13707]: 2007/09/19_15:12:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.87 cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:05 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:05 info: process_lrm_event: LRM operation drbdlinks-share_start_0 (call=19, rc=0) complete crmd[13713]: 2007/09/19_15:12:05 info: build_operation_update: Digest for 0:0;14:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbdlinks-share_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[13713]: 2007/09/19_15:12:05 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:12:05 info: process_lrm_event: LRM operation Filesystem-share_monitor_120000 (call=18, rc=0) complete crmd[13713]: 2007/09/19_15:12:06 info: do_lrm_rsc_op: Performing op=drbdlinks-share_monitor_120000 key=15:5:f9a72663-35e0-4964-ac99-7be9d3dba335) crmd[13713]: 2007/09/19_15:12:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=16:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.87 cibmon[13707]: 2007/09/19_15:12:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.88 cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.88 cibmon[13707]: 2007/09/19_15:12:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.89 cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:06 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:06 info: process_lrm_event: LRM operation drbdlinks-share_monitor_120000 (call=20, rc=0) complete IPaddr[14018][14051]: 2007/09/19_15:12:06 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[14018][14056]: 2007/09/19_15:12:06 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[14018][14078]: 2007/09/19_15:12:07 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[13713]: 2007/09/19_15:12:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=21, rc=0) complete crmd[13713]: 2007/09/19_15:12:07 info: build_operation_update: Digest for 0:0;16:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[13713]: 2007/09/19_15:12:07 info: log_data_element: build_operation_update: digest:source cibmon[13707]: 2007/09/19_15:12:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.89 cibmon[13707]: 2007/09/19_15:12:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.90 cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:07 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=17:5:f9a72663-35e0-4964-ac99-7be9d3dba335) cibmon[13707]: 2007/09/19_15:12:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.90 cibmon[13707]: 2007/09/19_15:12:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.91 cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:09 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=0) complete cibmon[13707]: 2007/09/19_15:12:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.91 cibmon[13707]: 2007/09/19_15:12:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.92 cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:10 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:12:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.92 cibmon[13707]: 2007/09/19_15:12:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.93 cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:12:59 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:12:59 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=12:6:f9a72663-35e0-4964-ac99-7be9d3dba335) msg[14261][14282]: 2007/09/19_15:12:59 INFO Starting to switch to this node. msg[14261][14283]: 2007/09/19_15:12:59 INFO Node: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:13:00 info: process_lrm_event: LRM operation msg_first_start_0 (call=23, rc=0) complete crmd[13713]: 2007/09/19_15:13:00 info: build_operation_update: Digest for 0:0;12:6:f9a72663-35e0-4964-ac99-7be9d3dba335 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[13713]: 2007/09/19_15:13:00 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:00 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] crmd[13713]: 2007/09/19_15:13:00 info: crmd_client_status_callback: Got client status callback - our DC is dead crmd[13713]: 2007/09/19_15:13:00 info: do_state_transition: State transition S_NOT_DC -> S_ELECTION [ input=I_ELECTION cause=C_CRMD_STATUS_CALLBACK origin=crmd_client_status_callback ] crmd[13713]: 2007/09/19_15:13:00 info: update_dc: Set DC to () cibmon[13707]: 2007/09/19_15:13:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[13707]: 2007/09/19_15:13:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.93 cibmon[13707]: 2007/09/19_15:13:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.94 cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cib[13709]: 2007/09/19_15:13:00 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: - cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + cibmon[13707]: 2007/09/19_15:13:00 info: log_data_element: cib_apply_diff: + crmd[13713]: 2007/09/19_15:13:00 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[13713]: 2007/09/19_15:13:00 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[13713]: 2007/09/19_15:13:00 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[13713]: 2007/09/19_15:13:01 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm crmd[13713]: 2007/09/19_15:13:01 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[13709]: 2007/09/19_15:13:01 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm cib[13709]: 2007/09/19_15:13:01 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[13709]: 2007/09/19_15:13:01 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[13713]: 2007/09/19_15:13:01 info: crmd_ccm_msg_callback: Quorum lost after event=NOT PRIMARY (id=4) heartbeat[13696]: 2007/09/19_15:13:05 info: killing /usr/lib/heartbeat/mgmtd -v process group 13714 with signal 15 mgmtd[13714]: 2007/09/19_15:13:05 info: mgmtd is shutting down heartbeat[13696]: 2007/09/19_15:13:05 info: killing /usr/lib/heartbeat/crmd process group 13713 with signal 15 crmd[13713]: 2007/09/19_15:13:05 info: crm_shutdown: Requesting shutdown crmd[13713]: 2007/09/19_15:13:05 info: do_shutdown_req: Sending shutdown request to DC: crmd[13713]: 2007/09/19_15:13:05 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[13713]: 2007/09/19_15:13:05 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[13713]: 2007/09/19_15:13:05 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[13713]: 2007/09/19_15:13:12 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[13713]: 2007/09/19_15:13:12 info: mem_handle_event: no mbr_track info crmd[13713]: 2007/09/19_15:13:12 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13713]: 2007/09/19_15:13:12 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[13713]: 2007/09/19_15:13:12 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=5) ccm[13708]: 2007/09/19_15:13:12 info: Break tie for 2 nodes cluster cib[13709]: 2007/09/19_15:13:12 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[13713]: 2007/09/19_15:13:12 info: ccm_event_detail: NEW MEMBERSHIP: trans=5, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cib[13709]: 2007/09/19_15:13:12 info: mem_handle_event: no mbr_track info crmd[13713]: 2007/09/19_15:13:12 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=5] cib[13709]: 2007/09/19_15:13:12 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13713]: 2007/09/19_15:13:12 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=2] cib[13709]: 2007/09/19_15:13:12 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[13713]: 2007/09/19_15:13:12 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] cib[13709]: 2007/09/19_15:13:12 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[13713]: 2007/09/19_15:13:12 info: start_subsystem: Starting sub-system "tengine" cib[13709]: 2007/09/19_15:13:12 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:13:12 info: start_subsystem: Starting sub-system "pengine" cibmon[13707]: 2007/09/19_15:13:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:13:12 info: log_cib_diff: cib_update: Local-only Change: 0.1.94 cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:12 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[14348]: 2007/09/19_15:13:12 info: G_main_add_TriggerHandler: Added signal manual handler crmd[13713]: 2007/09/19_15:13:12 info: do_dc_takeover: Taking over DC status for this partition pengine[14349]: 2007/09/19_15:13:12 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[13709]: 2007/09/19_15:13:12 info: cib_process_readwrite: We are now in R/W mode cib[13709]: 2007/09/19_15:13:12 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[14348]: 2007/09/19_15:13:12 info: te_init: Registering TE UUID: c63fdfd8-4045-4245-9082-6d29e37a77ac tengine[14348]: 2007/09/19_15:13:12 info: set_graph_functions: Setting custom graph functions tengine[14348]: 2007/09/19_15:13:12 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[14348]: 2007/09/19_15:13:12 info: te_init: Starting tengine pengine[14349]: 2007/09/19_15:13:12 info: pe_init: Starting pengine crmd[13713]: 2007/09/19_15:13:12 info: update_dc: Set DC to () crmd[13713]: 2007/09/19_15:13:12 info: join_make_offer: Making join offers based on membership 5 crmd[13713]: 2007/09/19_15:13:12 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cibmon[13707]: 2007/09/19_15:13:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:13:12 info: log_cib_diff: cib_update: Diff: --- 0.1.94 cibmon[13707]: 2007/09/19_15:13:12 info: log_cib_diff: cib_update: Diff: +++ 0.1.95 cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:12 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:13:12 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13713]: 2007/09/19_15:13:13 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] cib[13709]: 2007/09/19_15:13:13 info: sync_our_cib: Syncing CIB to all peers crmd[13713]: 2007/09/19_15:13:13 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[13713]: 2007/09/19_15:13:13 info: update_attrd: Connecting to attrd... attrd[13712]: 2007/09/19_15:13:13 info: attrd_local_callback: Sending full refresh cibmon[13707]: 2007/09/19_15:13:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:13:13 info: log_cib_diff: cib_update: Diff: --- 0.1.95 cibmon[13707]: 2007/09/19_15:13:13 info: log_cib_diff: cib_update: Diff: +++ 0.1.96 cibmon[13707]: 2007/09/19_15:13:13 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:13 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:13:13 info: log_cib_diff: cib_update: Diff: --- 0.1.96 cibmon[13707]: 2007/09/19_15:13:13 info: log_cib_diff: cib_update: Diff: +++ 0.1.97 cibmon[13707]: 2007/09/19_15:13:13 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:13 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:13:13 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;12:6:f9a72663-35e0-4964-ac99-7be9d3dba335 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;14:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbdlinks-share_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;8:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;16:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;12:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (Filesystem-share_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:13 info: build_operation_update: Digest for 0:0;10:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbd-share_start_0) was eaef18223bea84e8b011465368d9f74e crmd[13713]: 2007/09/19_15:13:13 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:13:14 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:13:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action msg_first_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_cib_diff: cib_update: Diff: --- 0.1.97 tengine[14348]: 2007/09/19_15:13:14 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13707]: 2007/09/19_15:13:14 info: log_cib_diff: cib_update: Diff: +++ 0.1.98 tengine[14348]: 2007/09/19_15:13:14 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action drbdlinks-share_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action msg_last_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - crmd[13713]: 2007/09/19_15:13:14 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action vmstat-mon_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - crmd[13713]: 2007/09/19_15:13:14 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action IPaddr_10_0_0_59_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action Filesystem-share_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:14 info: process_graph_event: Action drbd-share_monitor_0 initiated by a different transitioner cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:14 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:13:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:13:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:13:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:13:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:13:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:13:14 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:13:14 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[14349]: 2007/09/19_15:13:14 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:13:14 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:14 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca FAILED pengine[14349]: 2007/09/19_15:13:14 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource drbd-share (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource Filesystem-share (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource drbdlinks-share (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: NoRoleChange: Recover resource mysql (host-1.awale.qc.ca) pengine[14349]: 2007/09/19_15:13:14 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[14349]: 2007/09/19_15:13:14 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[14349]: 2007/09/19_15:13:14 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[14349]: 2007/09/19_15:13:14 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[14349]: 2007/09/19_15:13:14 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[14349]: 2007/09/19_15:13:14 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-33.bz2 crmd[13713]: 2007/09/19_15:13:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:14 info: unpack_graph: Unpacked transition 0: 22 actions in 22 synapses tengine[14348]: 2007/09/19_15:13:14 info: te_pseudo_action: Pseudo action 28 fired and confirmed tengine[14348]: 2007/09/19_15:13:14 info: te_pseudo_action: Pseudo action 30 fired and confirmed crmd[13713]: 2007/09/19_15:13:14 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=5:0:c63fdfd8-4045-4245-9082-6d29e37a77ac) tengine[14348]: 2007/09/19_15:13:14 info: send_rsc_command: Initiating action 5: mysql_stop_0 on host-1.awale.qc.ca lrmd[14350]: 2007/09/19_15:13:14 WARN: For LSB init script, no additional parameters are needed. lrmd[14350]: 2007/09/19_15:13:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[13713]: 2007/09/19_15:13:14 ERROR: process_lrm_event: LRM operation mysql_stop_0 (call=24, rc=254) Error cibmon[13707]: 2007/09/19_15:13:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:15 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: --- 0.1.98 tengine[14348]: 2007/09/19_15:13:15 info: update_abort_priority: Abort priority upgraded to 1 cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: +++ 0.1.99 tengine[14348]: 2007/09/19_15:13:15 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:15 info: match_graph_event: Action mysql_stop_0 (5) confirmed on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:15 info: run_graph: ==================================================== cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[14348]: 2007/09/19_15:13:15 notice: run_graph: Transition 0: (Complete=3, Pending=0, Fired=0, Skipped=19, Incomplete=0) cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:13:15 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:13:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:13:15 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:13:15 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[14349]: 2007/09/19_15:13:15 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource msg_first cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: unpack_graph: Unpacked transition 1: 9 actions in 9 synapses pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: te_pseudo_action: Pseudo action 17 fired and confirmed pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource drbd-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource Filesystem-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 notice: run_graph: ==================================================== pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource drbdlinks-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 WARN: run_graph: Transition 1: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=7) pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 ERROR: te_graph_trigger: Transition failed: terminated pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource mysql cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource msg_last cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 18]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 26]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 2 is pending (priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_shutdown_req: Processing shutdown locally tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 8 was confirmed (priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: --- 0.1.99 tengine[14348]: 2007/09/19_15:13:15 info: notify_crmd: Transition 1 status: te_complete - cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: +++ 0.1.100 crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:15 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[14348]: 2007/09/19_15:13:15 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:13:15 WARN: process_pe_message: Transition 1: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-15.bz2 pengine[14349]: 2007/09/19_15:13:15 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:13:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:13:15 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:13:15 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:13:15 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:13:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:15 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[14349]: 2007/09/19_15:13:15 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource msg_first cannot run anywhere pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource drbd-share cannot run anywhere pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource Filesystem-share cannot run anywhere pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource drbdlinks-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: unpack_graph: Unpacked transition 2: 10 actions in 10 synapses pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: te_pseudo_action: Pseudo action 17 fired and confirmed pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource mysql cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[14349]: 2007/09/19_15:13:15 WARN: native_color: Resource msg_last cannot run anywhere tengine[14348]: 2007/09/19_15:13:15 notice: run_graph: ==================================================== pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[14348]: 2007/09/19_15:13:15 WARN: run_graph: Transition 2: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=8) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[14348]: 2007/09/19_15:13:15 ERROR: te_graph_trigger: Transition failed: terminated pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 18]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[14349]: 2007/09/19_15:13:15 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 27]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 2 is pending (priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: do_shutdown_req: Processing shutdown locally tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) crmd[13713]: 2007/09/19_15:13:15 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: --- 0.1.100 tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: log_cib_diff: cib_update: Diff: +++ 0.1.101 tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 8 was confirmed (priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:15 WARN: print_graph: Synapse 9 is pending (priority: 0) cibmon[13707]: 2007/09/19_15:13:15 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: [Action 19]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:15 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:15 WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-16.bz2 tengine[14348]: 2007/09/19_15:13:15 info: notify_crmd: Transition 2 status: te_complete - pengine[14349]: 2007/09/19_15:13:15 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[13696]: 2007/09/19_15:13:31 WARN: node host-2.awale.qc.ca: is dead heartbeat[13696]: 2007/09/19_15:13:31 info: Link host-2.awale.qc.ca:eth0 dead. crmd[13713]: 2007/09/19_15:13:31 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] cibmon[13707]: 2007/09/19_15:13:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:31 info: te_update_diff: Aborting on transient_attributes deletions cibmon[13707]: 2007/09/19_15:13:31 info: log_cib_diff: cib_update: Local-only Change: 0.1.101 crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:31 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:13:31 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:13:31 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:13:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[14349]: 2007/09/19_15:13:31 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource msg_first cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource drbd-share cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource Filesystem-share cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource drbdlinks-share cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource mysql cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource msg_last cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:13:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:13:31 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[14349]: 2007/09/19_15:13:31 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:13:31 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:31 info: unpack_graph: Unpacked transition 3: 10 actions in 10 synapses tengine[14348]: 2007/09/19_15:13:31 info: te_pseudo_action: Pseudo action 17 fired and confirmed tengine[14348]: 2007/09/19_15:13:31 info: te_pseudo_action: Pseudo action 27 fired and confirmed tengine[14348]: 2007/09/19_15:13:31 notice: run_graph: ==================================================== tengine[14348]: 2007/09/19_15:13:31 WARN: run_graph: Transition 3: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=8) tengine[14348]: 2007/09/19_15:13:31 ERROR: te_graph_trigger: Transition failed: terminated crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 0 was confirmed (priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 1 is pending (priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 18]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: do_shutdown_req: Processing shutdown locally tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-17.bz2 tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 27]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 2 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 3 is pending (priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_cib_diff: cib_update: Diff: --- 0.1.101 tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_cib_diff: cib_update: Diff: +++ 0.1.102 tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 4 is pending (priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 5 is pending (priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 6 is pending (priority: 0) cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 9 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 19]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 info: notify_crmd: Transition 3 status: te_complete - tengine[14348]: 2007/09/19_15:13:31 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[14348]: 2007/09/19_15:13:31 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:13:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:13:31 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:13:31 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:13:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:13:31 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:13:31 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[14349]: 2007/09/19_15:13:31 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource msg_first cannot run anywhere pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 info: unpack_graph: Unpacked transition 4: 10 actions in 10 synapses pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource drbd-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 info: te_pseudo_action: Pseudo action 17 fired and confirmed pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource Filesystem-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 info: te_pseudo_action: Pseudo action 27 fired and confirmed pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource drbdlinks-share cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 notice: run_graph: ==================================================== pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 WARN: run_graph: Transition 4: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=8) pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource mysql cannot run anywhere tengine[14348]: 2007/09/19_15:13:31 ERROR: te_graph_trigger: Transition failed: terminated pengine[14349]: 2007/09/19_15:13:31 WARN: native_color: Resource msg_last cannot run anywhere crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop msg_first crmd[13713]: 2007/09/19_15:13:31 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon crmd[13713]: 2007/09/19_15:13:31 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 18]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share crmd[13713]: 2007/09/19_15:13:31 info: do_shutdown_req: Processing shutdown locally tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share crmd[13713]: 2007/09/19_15:13:31 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 WARN: should_dump_action: action 14 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 27]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 2 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 3 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 6 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 14]: Pending (id: mysql_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 17]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 8 was confirmed (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_graph: Synapse 9 is pending (priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: [Action 19]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) pengine[14349]: 2007/09/19_15:13:31 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-18.bz2 tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[14349]: 2007/09/19_15:13:31 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 9]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 10]: Pending (id: drbd-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 11]: Pending (id: Filesystem-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 12]: Pending (id: drbdlinks-share_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 WARN: print_elem: * [Input 13]: Pending (id: IPaddr_10_0_0_59_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[14348]: 2007/09/19_15:13:31 info: notify_crmd: Transition 4 status: te_complete - cibmon[13707]: 2007/09/19_15:13:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:13:31 info: log_cib_diff: cib_update: Diff: --- 0.1.102 cibmon[13707]: 2007/09/19_15:13:31 info: log_cib_diff: cib_update: Diff: +++ 0.1.103 cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:13:31 info: log_data_element: cib_update: + heartbeat[13696]: 2007/09/19_15:14:07 info: Heartbeat restart on node host-2.awale.qc.ca heartbeat[13696]: 2007/09/19_15:14:07 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[13696]: 2007/09/19_15:14:07 info: Status update for node host-2.awale.qc.ca: status init heartbeat[13696]: 2007/09/19_15:14:07 info: Status update for node host-2.awale.qc.ca: status up crmd[13713]: 2007/09/19_15:14:07 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] crmd[13713]: 2007/09/19_15:14:07 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[13696]: 2007/09/19_15:14:08 info: Status update for node host-2.awale.qc.ca: status active crmd[13713]: 2007/09/19_15:14:08 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] cibmon[13707]: 2007/09/19_15:14:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:08 info: log_cib_diff: cib_update: Local-only Change: 0.1.103 cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:08 info: log_data_element: cib_update: + cib[13709]: 2007/09/19_15:14:09 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[13696]: 2007/09/19_15:14:11 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [12:14] heartbeat[13696]: 2007/09/19_15:14:11 info: No pkts missing from host-2.awale.qc.ca! crmd[13713]: 2007/09/19_15:14:11 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[13707]: 2007/09/19_15:14:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:12 info: log_cib_diff: cib_update: Local-only Change: 0.1.103 cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:12 info: log_data_element: cib_update: + heartbeat[13696]: 2007/09/19_15:14:12 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [16:18] heartbeat[13696]: 2007/09/19_15:14:12 info: No pkts missing from host-2.awale.qc.ca! cib[13709]: 2007/09/19_15:14:14 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[13713]: 2007/09/19_15:14:14 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[13709]: 2007/09/19_15:14:14 info: mem_handle_event: no mbr_track info crmd[13713]: 2007/09/19_15:14:14 info: mem_handle_event: no mbr_track info cib[13709]: 2007/09/19_15:14:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[13713]: 2007/09/19_15:14:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[13709]: 2007/09/19_15:14:14 info: mem_handle_event: instance=6, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[13713]: 2007/09/19_15:14:14 info: mem_handle_event: instance=6, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[13709]: 2007/09/19_15:14:14 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:14:14 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=6) cib[13709]: 2007/09/19_15:14:14 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[13713]: 2007/09/19_15:14:14 info: ccm_event_detail: NEW MEMBERSHIP: trans=6, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[13713]: 2007/09/19_15:14:14 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=4] crmd[13713]: 2007/09/19_15:14:14 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=6] crmd[13713]: 2007/09/19_15:14:14 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=6] cibmon[13707]: 2007/09/19_15:14:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:14 info: log_cib_diff: cib_update: Local-only Change: 0.1.103 cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:14 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:16 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[13713]: 2007/09/19_15:14:16 info: update_dc: Set DC to () crmd[13713]: 2007/09/19_15:14:16 info: join_make_offer: Making join offers based on membership 6 tengine[14348]: 2007/09/19_15:14:16 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[13713]: 2007/09/19_15:14:16 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks crmd[13713]: 2007/09/19_15:14:16 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) attrd[13712]: 2007/09/19_15:14:17 info: attrd_local_callback: Sending full refresh crmd[13713]: 2007/09/19_15:14:17 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] cib[13709]: 2007/09/19_15:14:17 info: sync_our_cib: Syncing CIB to all peers crmd[13713]: 2007/09/19_15:14:17 info: do_state_transition: All 2 cluster nodes responded to the join offer. cibmon[13707]: 2007/09/19_15:14:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: --- 0.1.103 cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: +++ 0.1.104 cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: --- 0.1.104 cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: +++ 0.1.105 cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: --- 0.1.105 cibmon[13707]: 2007/09/19_15:14:17 info: log_cib_diff: cib_update: Diff: +++ 0.1.106 cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:17 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:17 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;12:6:f9a72663-35e0-4964-ac99-7be9d3dba335 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;14:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbdlinks-share_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;8:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;16:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;12:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (Filesystem-share_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:17 info: build_operation_update: Digest for 0:0;10:5:f9a72663-35e0-4964-ac99-7be9d3dba335 (drbd-share_start_0) was eaef18223bea84e8b011465368d9f74e crmd[13713]: 2007/09/19_15:14:17 info: log_data_element: build_operation_update: digest:source crmd[13713]: 2007/09/19_15:14:18 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:18 info: log_cib_diff: cib_update: Diff: --- 0.1.106 cibmon[13707]: 2007/09/19_15:14:18 info: log_cib_diff: cib_update: Diff: +++ 0.1.107 cibmon[13707]: 2007/09/19_15:14:18 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:18 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:19 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca crmd[13713]: 2007/09/19_15:14:19 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[13707]: 2007/09/19_15:14:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[13713]: 2007/09/19_15:14:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[13707]: 2007/09/19_15:14:19 info: log_cib_diff: cib_update: Diff: --- 0.1.107 cibmon[13707]: 2007/09/19_15:14:19 info: log_cib_diff: cib_update: Diff: +++ 0.1.108 cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 info: determine_online_status: Node host-2.awale.qc.ca is online cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 info: group_print: Resource Group: group-DW cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: - pengine[14349]: 2007/09/19_15:14:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:19 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:19 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:19 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:19 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:19 info: native_print: mysql (lsb:mysql): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[14349]: 2007/09/19_15:14:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:14:19 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource drbd-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource Filesystem-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource drbdlinks-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[14349]: 2007/09/19_15:14:19 notice: NoRoleChange: Recover resource mysql (host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:19 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[14349]: 2007/09/19_15:14:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[14349]: 2007/09/19_15:14:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[14349]: 2007/09/19_15:14:19 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[14349]: 2007/09/19_15:14:19 WARN: should_dump_action: action 35 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:19 WARN: should_dump_action: action 36 (mysql_start_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:19 WARN: should_dump_action: action 35 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:19 WARN: should_dump_action: action 36 (mysql_start_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:19 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-19.bz2 pengine[14349]: 2007/09/19_15:14:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[13713]: 2007/09/19_15:14:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:14:19 info: unpack_graph: Unpacked transition 5: 36 actions in 36 synapses tengine[14348]: 2007/09/19_15:14:19 info: te_pseudo_action: Pseudo action 41 fired and confirmed tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 8: msg_first_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 9: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 10: drbd-share_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 11: Filesystem-share_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 12: drbdlinks-share_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 13: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 14: mysql_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[14348]: 2007/09/19_15:14:19 info: te_pseudo_action: Pseudo action 44 fired and confirmed cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action drbd-share_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.108 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.109 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action vmstat-mon_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.109 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.110 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.110 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.111 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action msg_first_monitor_0 (8) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action Filesystem-share_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.111 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.112 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:21 WARN: status_from_rc: Action monitor on host-2.awale.qc.ca failed (target: 7 vs. rc: 254): Error cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.112 tengine[14348]: 2007/09/19_15:14:21 info: update_abort_priority: Abort priority upgraded to 1 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.113 tengine[14348]: 2007/09/19_15:14:21 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action mysql_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action drbdlinks-share_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.113 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.114 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.114 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.115 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:21 info: run_graph: ==================================================== crmd[13713]: 2007/09/19_15:14:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:14:21 notice: run_graph: Transition 5: (Complete=10, Pending=0, Fired=0, Skipped=25, Incomplete=1) cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[13713]: 2007/09/19_15:14:21 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.115 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.116 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:14:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:14:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:14:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:14:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:14:21 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:14:21 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[14349]: 2007/09/19_15:14:21 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[14349]: 2007/09/19_15:14:21 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-2.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_add_running: resource mysql isnt managed pengine[14349]: 2007/09/19_15:14:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:21 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:14:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: mysql (lsb:mysql) pengine[14349]: 2007/09/19_15:14:21 info: native_print: 0 : host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: 1 : host-2.awale.qc.ca pengine[14349]: 2007/09/19_15:14:21 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource drbd-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource Filesystem-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop Filesystem-share pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource drbdlinks-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop drbdlinks-share pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 crmd[13713]: 2007/09/19_15:14:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:14:21 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:21 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[14349]: 2007/09/19_15:14:21 ERROR: native_create_actions: Attempting recovery of resource mysql pengine[14349]: 2007/09/19_15:14:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:21 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[14349]: 2007/09/19_15:14:21 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[14349]: 2007/09/19_15:14:21 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[14349]: 2007/09/19_15:14:21 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[14349]: 2007/09/19_15:14:21 WARN: should_dump_action: action 29 (mysql_start_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:21 WARN: should_dump_action: action 29 (mysql_start_0) was for an unmanaged resource (mysql) crmd[13713]: 2007/09/19_15:14:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=25:6:c63fdfd8-4045-4245-9082-6d29e37a77ac) tengine[14348]: 2007/09/19_15:14:21 info: unpack_graph: Unpacked transition 6: 27 actions in 27 synapses pengine[14349]: 2007/09/19_15:14:21 ERROR: process_pe_message: Transition 6: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-3.bz2 tengine[14348]: 2007/09/19_15:14:21 info: te_pseudo_action: Pseudo action 34 fired and confirmed pengine[14349]: 2007/09/19_15:14:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[14348]: 2007/09/19_15:14:21 info: send_rsc_command: Initiating action 25: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:14:21 info: te_pseudo_action: Pseudo action 37 fired and confirmed tengine[14348]: 2007/09/19_15:14:21 info: send_rsc_command: Initiating action 8: probe_complete on host-2.awale.qc.ca crmd[13713]: 2007/09/19_15:14:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_delete: Diff: --- 0.1.116 cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_delete: Diff: +++ 0.1.117 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_delete: + lrmd[13710]: 2007/09/19_15:14:21 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[13710]: 2007/09/19_15:14:21 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[14598][14613]: 2007/09/19_15:14:21 INFO: ifconfig eth0:0 down crmd[13713]: 2007/09/19_15:14:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=25, rc=0) complete cibmon[13707]: 2007/09/19_15:14:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:21 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (25) confirmed on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: --- 0.1.117 crmd[13713]: 2007/09/19_15:14:21 info: do_lrm_rsc_op: Performing op=drbdlinks-share_stop_0 key=22:6:c63fdfd8-4045-4245-9082-6d29e37a77ac) tengine[14348]: 2007/09/19_15:14:21 info: send_rsc_command: Initiating action 22: drbdlinks-share_stop_0 on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:21 info: log_cib_diff: cib_update: Diff: +++ 0.1.118 cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:21 info: process_lrm_event: LRM operation drbdlinks-share_monitor_120000 (call=20, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:21 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_delete: Diff: --- 0.1.118 cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_delete: Diff: +++ 0.1.119 cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: + crmd[13713]: 2007/09/19_15:14:22 info: process_lrm_event: LRM operation drbdlinks-share_stop_0 (call=26, rc=0) complete tengine[14348]: 2007/09/19_15:14:22 info: match_graph_event: Action drbdlinks-share_stop_0 (22) confirmed on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:22 info: send_rsc_command: Initiating action 19: Filesystem-share_stop_0 on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_update: Diff: --- 0.1.119 cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_update: Diff: +++ 0.1.120 cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:22 info: do_lrm_rsc_op: Performing op=Filesystem-share_stop_0 key=19:6:c63fdfd8-4045-4245-9082-6d29e37a77ac) cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:22 info: process_lrm_event: LRM operation Filesystem-share_monitor_120000 (call=18, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:22 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_delete: Diff: --- 0.1.120 cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_delete: Diff: +++ 0.1.121 cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_delete: + tengine[14348]: 2007/09/19_15:14:22 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e tengine[14348]: 2007/09/19_15:14:22 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[14348]: 2007/09/19_15:14:22 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[13707]: 2007/09/19_15:14:22 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_modify: Diff: --- 0.1.121 cibmon[13707]: 2007/09/19_15:14:22 info: log_cib_diff: cib_modify: Diff: +++ 0.1.122 cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: - cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + cibmon[13707]: 2007/09/19_15:14:22 info: log_data_element: cib_modify: + Filesystem[14620][14649]: 2007/09/19_15:14:22 INFO: Running stop for /dev/drbd0 on /share Filesystem[14620][14659]: 2007/09/19_15:14:22 INFO: Trying to unmount /share Filesystem[14620][14661]: 2007/09/19_15:14:22 INFO: unmounted /share successfully crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation Filesystem-share_stop_0 (call=27, rc=0) complete tengine[14348]: 2007/09/19_15:14:23 info: match_graph_event: Action Filesystem-share_stop_0 (19) confirmed on host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:14:23 info: run_graph: ==================================================== crmd[13713]: 2007/09/19_15:14:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:14:23 notice: run_graph: Transition 6: (Complete=6, Pending=0, Fired=0, Skipped=21, Incomplete=0) crmd[13713]: 2007/09/19_15:14:23 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: --- 0.1.122 cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: +++ 0.1.123 cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + pengine[14349]: 2007/09/19_15:14:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[14349]: 2007/09/19_15:14:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[14349]: 2007/09/19_15:14:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[14349]: 2007/09/19_15:14:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[14349]: 2007/09/19_15:14:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[14349]: 2007/09/19_15:14:23 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[14349]: 2007/09/19_15:14:23 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[14349]: 2007/09/19_15:14:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[14349]: 2007/09/19_15:14:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-2.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_add_running: resource mysql isnt managed pengine[14349]: 2007/09/19_15:14:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:23 info: group_print: Resource Group: group-DW pengine[14349]: 2007/09/19_15:14:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_print: drbd-share (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_print: Filesystem-share (heartbeat::ocf:Filesystem): Stopped pengine[14349]: 2007/09/19_15:14:23 info: native_print: drbdlinks-share (heartbeat:drbdlinks): Stopped pengine[14349]: 2007/09/19_15:14:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[14349]: 2007/09/19_15:14:23 info: native_print: mysql (lsb:mysql) pengine[14349]: 2007/09/19_15:14:23 info: native_print: 0 : host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_print: 1 : host-2.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 info: native_print: msg_last (heartbeat:msg): Stopped pengine[14349]: 2007/09/19_15:14:23 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:23 notice: StopRsc: host-1.awale.qc.ca Stop msg_first crmd[13713]: 2007/09/19_15:14:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[14349]: 2007/09/19_15:14:23 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:23 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[14349]: 2007/09/19_15:14:23 notice: NoRoleChange: Move resource drbd-share (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[14349]: 2007/09/19_15:14:23 notice: StopRsc: host-1.awale.qc.ca Stop drbd-share pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start drbd-share pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca drbd-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start Filesystem-share pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca Filesystem-share_monitor_120000 pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start drbdlinks-share tengine[14348]: 2007/09/19_15:14:23 info: unpack_graph: Unpacked transition 7: 23 actions in 23 synapses pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca drbdlinks-share_monitor_120000 tengine[14348]: 2007/09/19_15:14:23 info: te_pseudo_action: Pseudo action 28 fired and confirmed pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 tengine[14348]: 2007/09/19_15:14:23 info: send_rsc_command: Initiating action 13: drbd-share_stop_0 on host-1.awale.qc.ca pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[14349]: 2007/09/19_15:14:23 ERROR: native_create_actions: Attempting recovery of resource mysql pengine[14349]: 2007/09/19_15:14:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:23 WARN: custom_action: Action mysql_start_0 (unmanaged) pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[14349]: 2007/09/19_15:14:23 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[14349]: 2007/09/19_15:14:23 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[14349]: 2007/09/19_15:14:23 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[14349]: 2007/09/19_15:14:23 WARN: should_dump_action: action 23 (mysql_start_0) was for an unmanaged resource (mysql) pengine[14349]: 2007/09/19_15:14:23 WARN: should_dump_action: action 23 (mysql_start_0) was for an unmanaged resource (mysql) tengine[14348]: 2007/09/19_15:14:23 info: te_pseudo_action: Pseudo action 34 fired and confirmed pengine[14349]: 2007/09/19_15:14:23 ERROR: process_pe_message: Transition 7: ERRORs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-error-4.bz2 crmd[13713]: 2007/09/19_15:14:23 info: do_lrm_rsc_op: Performing op=drbd-share_stop_0 key=13:7:c63fdfd8-4045-4245-9082-6d29e37a77ac) pengine[14349]: 2007/09/19_15:14:23 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation drbd-share_monitor_120000 (call=16, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: --- 0.1.123 cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: +++ 0.1.124 cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: + crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation drbd-share_stop_0 (call=28, rc=0) complete tengine[14348]: 2007/09/19_15:14:23 info: match_graph_event: Action drbd-share_stop_0 (13) confirmed on host-1.awale.qc.ca tengine[14348]: 2007/09/19_15:14:23 info: send_rsc_command: Initiating action 10: vmstat-mon_stop_0 on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: --- 0.1.124 cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: +++ 0.1.125 crmd[13713]: 2007/09/19_15:14:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=10:7:c63fdfd8-4045-4245-9082-6d29e37a77ac) cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=14, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: --- 0.1.125 cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: +++ 0.1.126 cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: + daemontools[14669][14678]: 2007/09/19_15:14:23 INFO Stoping vmstat-mon crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=29, rc=0) complete cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:23 info: match_graph_event: Action vmstat-mon_stop_0 (10) confirmed on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: --- 0.1.126 tengine[14348]: 2007/09/19_15:14:23 info: send_rsc_command: Initiating action 7: msg_first_stop_0 on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_update: Diff: +++ 0.1.127 cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:23 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=7:7:c63fdfd8-4045-4245-9082-6d29e37a77ac) cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:23 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=12, rc=-2) Cancelled cibmon[13707]: 2007/09/19_15:14:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: --- 0.1.127 cibmon[13707]: 2007/09/19_15:14:23 info: log_cib_diff: cib_delete: Diff: +++ 0.1.128 cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: - cibmon[13707]: 2007/09/19_15:14:23 info: log_data_element: cib_delete: + msg[14681][14702]: 2007/09/19_15:14:23 INFO Completed switching away from this node. msg[14681][14703]: 2007/09/19_15:14:23 INFO Node: host-1.awale.qc.ca crmd[13713]: 2007/09/19_15:14:24 info: process_lrm_event: LRM operation msg_first_stop_0 (call=30, rc=0) complete cibmon[13707]: 2007/09/19_15:14:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:24 info: match_graph_event: Action msg_first_stop_0 (7) confirmed on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:24 info: log_cib_diff: cib_update: Diff: --- 0.1.128 crmd[13713]: 2007/09/19_15:14:24 info: handle_request: Shutting ourselves down (DC) tengine[14348]: 2007/09/19_15:14:24 info: te_pseudo_action: Pseudo action 29 fired and confirmed pengine[14349]: 2007/09/19_15:14:24 info: pengine_shutdown: Exiting PEngine (SIGTERM) cibmon[13707]: 2007/09/19_15:14:24 info: log_cib_diff: cib_update: Diff: +++ 0.1.129 crmd[13713]: 2007/09/19_15:14:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ] tengine[14348]: 2007/09/19_15:14:24 info: te_crm_command: Executing crm-event (30): do_shutdown on host-1.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: - crmd[13713]: 2007/09/19_15:14:24 info: do_dc_release: DC role released tengine[14348]: 2007/09/19_15:14:24 info: te_crm_command: Skipping wait for 30 cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to pengine: [14349] tengine[14348]: 2007/09/19_15:14:24 info: te_pseudo_action: Pseudo action 26 fired and confirmed cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to tengine: [14348] tengine[14348]: 2007/09/19_15:14:24 info: send_rsc_command: Initiating action 8: msg_first_start_0 on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the pengine tengine[14348]: 2007/09/19_15:14:24 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to pengine: [14349] tengine[14348]: 2007/09/19_15:14:24 info: update_abort_priority: Abort action 0 superceeded by 3 cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the tengine cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to tengine: [14348] cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Waiting for subsystems to exit cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the pengine cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to pengine: [14349] cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the tengine cibmon[13707]: 2007/09/19_15:14:24 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to tengine: [14348] crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Waiting for subsystems to exit crmd[13713]: 2007/09/19_15:14:24 info: crmdManagedChildDied: Process pengine:[14349] exited (signal=0, exitcode=0) crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the tengine crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to tengine: [14348] crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Waiting for subsystems to exit crmd[13713]: 2007/09/19_15:14:24 info: process_client_disconnect: Received HUP from pengine:[-1] crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Terminating the tengine crmd[13713]: 2007/09/19_15:14:24 info: stop_subsystem: Sent -TERM to tengine: [14348] crmd[13713]: 2007/09/19_15:14:24 info: do_shutdown: Waiting for subsystems to exit cibmon[13707]: 2007/09/19_15:14:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[14348]: 2007/09/19_15:14:26 info: match_graph_event: Action msg_first_start_0 (8) confirmed on host-2.awale.qc.ca cibmon[13707]: 2007/09/19_15:14:26 info: log_cib_diff: cib_update: Diff: --- 0.1.129 tengine[14348]: 2007/09/19_15:14:26 info: run_graph: ==================================================== cibmon[13707]: 2007/09/19_15:14:26 info: log_cib_diff: cib_update: Diff: +++ 0.1.130 tengine[14348]: 2007/09/19_15:14:26 notice: run_graph: Transition 7: (Complete=9, Pending=0, Fired=0, Skipped=14, Incomplete=0) cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: - tengine[14348]: 2007/09/19_15:14:26 info: notify_crmd: Exiting after transition cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + tengine[14348]: 2007/09/19_15:14:26 info: te_init: Exiting tengine cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:26 info: crmdManagedChildDied: Process tengine:[14348] exited (signal=0, exitcode=0) cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:26 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:26 info: verify_stopped: Checking for active resources before exit cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + cibmon[13707]: 2007/09/19_15:14:26 info: log_data_element: cib_update: + crmd[13713]: 2007/09/19_15:14:26 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. ccm[13708]: 2007/09/19_15:14:26 info: client (pid=13713) removed from ccm crmd[13713]: 2007/09/19_15:14:26 info: verify_stopped: Checking for active resources before exit crmd[13713]: 2007/09/19_15:14:26 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. crmd[13713]: 2007/09/19_15:14:26 info: do_lrm_control: Disconnected from the LRM cib[13709]: 2007/09/19_15:14:26 info: cib_process_readwrite: We are now in R/O mode crmd[13713]: 2007/09/19_15:14:26 info: do_ha_control: Disconnected from Heartbeat crmd[13713]: 2007/09/19_15:14:26 info: do_cib_control: Disconnecting CIB crmd[13713]: 2007/09/19_15:14:26 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[13713]: 2007/09/19_15:14:26 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[13713]: 2007/09/19_15:14:26 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13713]: 2007/09/19_15:14:26 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[13713]: 2007/09/19_15:14:26 info: do_exit: [crmd] stopped (0) heartbeat[13696]: 2007/09/19_15:14:26 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 410 ms (> 100 ms) before being called (GSource: 0x9d49de8) heartbeat[13696]: 2007/09/19_15:14:26 info: G_SIG_dispatch: started at 429964075 should have started at 429964034 heartbeat[13696]: 2007/09/19_15:14:26 info: killing /usr/lib/heartbeat/attrd process group 13712 with signal 15 attrd[13712]: 2007/09/19_15:14:26 info: attrd_shutdown: Exiting attrd[13712]: 2007/09/19_15:14:26 info: main: Exiting... heartbeat[13696]: 2007/09/19_15:14:26 info: killing /usr/lib/heartbeat/stonithd process group 13711 with signal 15 stonithd[13711]: 2007/09/19_15:14:26 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[13696]: 2007/09/19_15:14:26 info: killing /usr/lib/heartbeat/lrmd -r process group 13710 with signal 15 lrmd[13710]: 2007/09/19_15:14:26 info: lrmd is shutting down heartbeat[13696]: 2007/09/19_15:14:26 info: killing /usr/lib/heartbeat/cib process group 13709 with signal 15 cibmon[13707]: 2007/09/19_15:14:26 ERROR: cib_native_msgready: Message pending on command channel [13709] cib[13709]: 2007/09/19_15:14:26 WARN: disconnect_cib_client: Disconnecting /cib_ro... cibmon[13707]: 2007/09/19_15:14:26 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[13709]: 2007/09/19_15:14:26 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[13707]: 2007/09/19_15:14:26 ERROR: MSG: No message to dump cib[13709]: 2007/09/19_15:14:26 info: cib_shutdown: Disconnected 2 clients cibmon[13707]: 2007/09/19_15:14:26 info: cib_native_msgready: Lost connection to the CIB service [13709]. cib[13709]: 2007/09/19_15:14:26 info: cib_process_disconnect: All clients disconnected... cibmon[13707]: 2007/09/19_15:14:26 CRIT: cib_native_dispatch: Lost connection to the CIB service [13709/callback]. cib[13709]: 2007/09/19_15:14:26 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[13707]: 2007/09/19_15:14:26 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[13709]: 2007/09/19_15:14:27 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[13709]: 2007/09/19_15:14:27 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[13709]: 2007/09/19_15:14:27 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[13709]: 2007/09/19_15:14:27 info: main: Done heartbeat[13696]: 2007/09/19_15:14:27 info: killing /usr/lib/heartbeat/ccm process group 13708 with signal 15 ccm[13708]: 2007/09/19_15:14:27 info: received SIGTERM, going to shut down heartbeat[13696]: 2007/09/19_15:14:27 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[13696]: 2007/09/19_15:14:28 info: killing HBFIFO process 13700 with signal 15 heartbeat[13696]: 2007/09/19_15:14:28 info: killing HBWRITE process 13701 with signal 15 heartbeat[13696]: 2007/09/19_15:14:28 info: killing HBREAD process 13702 with signal 15 heartbeat[13696]: 2007/09/19_15:14:28 info: killing HBWRITE process 13703 with signal 15 heartbeat[13696]: 2007/09/19_15:14:28 info: killing HBREAD process 13704 with signal 15 heartbeat[13696]: 2007/09/19_15:14:28 info: Core process 13700 exited. 5 remaining heartbeat[13696]: 2007/09/19_15:14:28 info: Core process 13702 exited. 4 remaining heartbeat[13696]: 2007/09/19_15:14:28 info: Core process 13704 exited. 3 remaining heartbeat[13696]: 2007/09/19_15:14:28 info: Core process 13701 exited. 2 remaining heartbeat[13696]: 2007/09/19_15:14:28 info: Core process 13703 exited. 1 remaining heartbeat[13696]: 2007/09/19_15:14:28 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[13677]: 2007/09/19_15:14:29 info: logd_term_write_action: received SIGTERM logd[13677]: 2007/09/19_15:14:29 info: Exiting write process logd[14786]: 2007/09/19_15:18:05 info: logd started with /etc/logd.cf. logd[14791]: 2007/09/19_15:18:05 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[14786]: 2007/09/19_15:18:05 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[14807]: 2007/09/19_15:18:05 info: No log entry found in ha.cf -- use logd heartbeat[14807]: 2007/09/19_15:18:05 info: Enabling logging daemon heartbeat[14807]: 2007/09/19_15:18:05 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[14807]: 2007/09/19_15:18:05 info: ************************** heartbeat[14807]: 2007/09/19_15:18:05 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[14808]: 2007/09/19_15:18:05 info: heartbeat: version 2.1.2 heartbeat[14808]: 2007/09/19_15:18:05 info: Heartbeat generation: 1188360844 heartbeat[14808]: 2007/09/19_15:18:05 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[14808]: 2007/09/19_15:18:05 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[14808]: 2007/09/19_15:18:05 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[14808]: 2007/09/19_15:18:05 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[14808]: 2007/09/19_15:18:05 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[14808]: 2007/09/19_15:18:05 info: glib: ping group heartbeat started. heartbeat[14808]: 2007/09/19_15:18:05 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[14808]: 2007/09/19_15:18:05 info: Local status now set to: 'up' heartbeat[14808]: 2007/09/19_15:18:06 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[14808]: 2007/09/19_15:18:06 info: Status update for node host-2.awale.qc.ca: status up heartbeat[14808]: 2007/09/19_15:18:06 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[14808]: 2007/09/19_15:18:06 info: Link local:local up. heartbeat[14808]: 2007/09/19_15:18:06 info: Status update for node local: status ping heartbeat[14808]: 2007/09/19_15:18:07 info: Comm_now_up(): updating status to active heartbeat[14808]: 2007/09/19_15:18:07 info: Local status now set to: 'active' heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[14819]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 14819) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[14808]: 2007/09/19_15:18:07 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[14808]: 2007/09/19_15:18:07 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 100 ms (> 50 ms) (GSource: 0x8c71110) heartbeat[14820]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 14820) heartbeat[14821]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 14821) cibmon[14819]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[14824]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 14824) heartbeat[14825]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 14825) heartbeat[14822]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 14822) heartbeat[14823]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 14823) cib[14821]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[14825]: 2007/09/19_15:18:07 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[14825]: 2007/09/19_15:18:07 info: crmd_init: Starting crmd crmd[14825]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[14825]: 2007/09/19_15:18:07 info: G_main_add_TriggerHandler: Added signal manual handler crmd[14825]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[14821]: 2007/09/19_15:18:07 info: G_main_add_TriggerHandler: Added signal manual handler cib[14821]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[14821]: 2007/09/19_15:18:07 info: main: Retrieval of a per-action CIB: disabled cib[14821]: 2007/09/19_15:18:07 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml lrmd[14822]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[14821]: 2007/09/19_15:18:07 WARN: validate_cib_digest: No on-disk digest present cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] lrmd[14822]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[14822]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[14822]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[14822]: 2007/09/19_15:18:07 info: Started. cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] attrd[14824]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] attrd[14824]: 2007/09/19_15:18:07 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] heartbeat[14826]: 2007/09/19_15:18:07 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 14826) heartbeat[14808]: 2007/09/19_15:18:07 info: Status update for node host-2.awale.qc.ca: status active attrd[14824]: 2007/09/19_15:18:07 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: log_data_element: readCibXmlFile: [on-disk] cib[14821]: 2007/09/19_15:18:07 info: startCib: CIB Initialization completed successfully cib[14821]: 2007/09/19_15:18:07 info: cib_register_ha: Signing in with Heartbeat mgmtd[14826]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[14826]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[14826]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 12 ccm[14820]: 2007/09/19_15:18:07 info: Hostname: host-1.awale.qc.ca cib[14821]: 2007/09/19_15:18:07 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[14821]: 2007/09/19_15:18:07 WARN: cib_init: CCM Activation failed cib[14821]: 2007/09/19_15:18:07 WARN: cib_init: CCM Connection failed 1 times (30 max) mgmtd[14826]: 2007/09/19_15:18:07 info: init_crm stonithd[14823]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[14823]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[14823]: 2007/09/19_15:18:07 info: Signing in with heartbeat. stonithd[14823]: 2007/09/19_15:18:07 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[14823]: 2007/09/19_15:18:07 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[14821]: 2007/09/19_15:18:08 WARN: cib_init: CCM Activation failed cib[14821]: 2007/09/19_15:18:08 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[14820]: 2007/09/19_15:18:08 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[14808]: 2007/09/19_15:18:09 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [15:17] heartbeat[14808]: 2007/09/19_15:18:09 info: No pkts missing from host-2.awale.qc.ca! cib[14821]: 2007/09/19_15:18:09 info: cib_init: Starting cib mainloop cib[14829]: 2007/09/19_15:18:09 WARN: validate_cib_digest: No on-disk digest present cib[14821]: 2007/09/19_15:18:09 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cibmon[14819]: 2007/09/19_15:18:09 info: main: Starting mainloop cib[14821]: 2007/09/19_15:18:09 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[14825]: 2007/09/19_15:18:09 info: do_cib_control: CIB connection established cib[14821]: 2007/09/19_15:18:09 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[14821]: 2007/09/19_15:18:09 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[14821]: 2007/09/19_15:18:09 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] cib[14821]: 2007/09/19_15:18:09 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] crmd[14825]: 2007/09/19_15:18:09 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[14829]: 2007/09/19_15:18:09 info: write_cib_contents: Wrote version 0.1.56 of the CIB to disk (digest: 7191800656de80384e388f8593f3a036) cib[14821]: 2007/09/19_15:18:10 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[14825]: 2007/09/19_15:18:10 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 heartbeat[14808]: 2007/09/19_15:18:10 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [21:23] heartbeat[14808]: 2007/09/19_15:18:10 info: No pkts missing from host-2.awale.qc.ca! crmd[14825]: 2007/09/19_15:18:10 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[14826]: 2007/09/19_15:18:11 info: Started. crmd[14825]: 2007/09/19_15:18:12 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) cib[14821]: 2007/09/19_15:18:12 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[14821]: 2007/09/19_15:18:12 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[14825]: 2007/09/19_15:18:12 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) cib[14821]: 2007/09/19_15:18:12 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[14825]: 2007/09/19_15:18:12 info: do_ha_control: Connected to Heartbeat cib[14821]: 2007/09/19_15:18:12 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[14825]: 2007/09/19_15:18:12 info: do_ccm_control: CCM connection established... waiting for first callback crmd[14825]: 2007/09/19_15:18:12 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[14825]: 2007/09/19_15:18:12 info: crmd_init: Starting crmd's mainloop crmd[14825]: 2007/09/19_15:18:12 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[14825]: 2007/09/19_15:18:13 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[14819]: 2007/09/19_15:18:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[14819]: 2007/09/19_15:18:13 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] crmd[14825]: 2007/09/19_15:18:13 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' cibmon[14819]: 2007/09/19_15:18:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[14825]: 2007/09/19_15:18:13 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' cibmon[14819]: 2007/09/19_15:18:13 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 crmd[14825]: 2007/09/19_15:18:13 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=1] cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + crmd[14825]: 2007/09/19_15:18:13 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=2] crmd[14825]: 2007/09/19_15:18:13 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=1] crmd[14825]: 2007/09/19_15:18:13 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=2] crmd[14825]: 2007/09/19_15:18:13 info: do_started: The local CRM is operational crmd[14825]: 2007/09/19_15:18:13 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[14825]: 2007/09/19_15:18:13 info: update_dc: Set DC to () cibmon[14819]: 2007/09/19_15:18:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[14819]: 2007/09/19_15:18:13 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + cibmon[14819]: 2007/09/19_15:18:13 info: log_data_element: cib_update: + attrd[14824]: 2007/09/19_15:18:17 info: main: Starting mainloop... crmd[14825]: 2007/09/19_15:20:14 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[14825]: 2007/09/19_15:20:14 info: update_dc: Set DC to () crmd[14825]: 2007/09/19_15:20:14 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[14825]: 2007/09/19_15:20:14 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[14825]: 2007/09/19_15:20:14 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[14825]: 2007/09/19_15:20:14 info: update_dc: Set DC to () crmd[14825]: 2007/09/19_15:20:15 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[14825]: 2007/09/19_15:20:15 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[14825]: 2007/09/19_15:20:15 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[14825]: 2007/09/19_15:20:16 WARN: do_log: [[FSA]] Input I_JOIN_OFFER from route_message() received in state (S_ELECTION) cib[14821]: 2007/09/19_15:20:16 WARN: cib_process_diff: Diff 0.0.0 -> 0.0.1 not applied to 0.1.56: current "epoch" is greater than required crmd[14825]: 2007/09/19_15:20:16 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca cib[14821]: 2007/09/19_15:20:16 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed crmd[14825]: 2007/09/19_15:20:16 info: update_dc: Set DC to () cib[14821]: 2007/09/19_15:20:16 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed crmd[14825]: 2007/09/19_15:20:16 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[14825]: 2007/09/19_15:20:16 info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[14825]: 2007/09/19_15:20:16 info: update_dc: Set DC to () crmd[14825]: 2007/09/19_15:20:16 info: do_dc_release: DC role released cib[14821]: 2007/09/19_15:20:17 WARN: cib_process_diff: Diff 0.0.1 -> 0.0.2 not applied to 0.1.56: current "epoch" is greater than required crmd[14825]: 2007/09/19_15:20:17 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cib[14821]: 2007/09/19_15:20:17 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed cib[14821]: 2007/09/19_15:20:17 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed cib[14821]: 2007/09/19_15:20:18 info: sync_our_cib: Syncing CIB to all peers crmd[14825]: 2007/09/19_15:20:21 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[14825]: 2007/09/19_15:20:21 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] crmd[14825]: 2007/09/19_15:20:21 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[14825]: 2007/09/19_15:20:21 info: update_dc: Set DC to () crmd[14825]: 2007/09/19_15:20:21 info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[14825]: 2007/09/19_15:20:21 info: update_dc: Set DC to () cibmon[14819]: 2007/09/19_15:20:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.56 cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.57 cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.57 cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.58 cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.58 cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.59 cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.59 cibmon[14819]: 2007/09/19_15:20:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.60 cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:21 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:22 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[14819]: 2007/09/19_15:20:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.60 cibmon[14819]: 2007/09/19_15:20:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.61 cibmon[14819]: 2007/09/19_15:20:22 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:22 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:24 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[14825]: 2007/09/19_15:20:24 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cibmon[14819]: 2007/09/19_15:20:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.61 cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.62 cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.62 cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.63 cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.63 cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.64 cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.64 cibmon[14819]: 2007/09/19_15:20:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.65 cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:24 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[14825]: 2007/09/19_15:20:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=12:0:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.65 cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.66 cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.66 cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.67 cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.67 cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.68 cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=13:0:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=14:0:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.68 cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.69 cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.69 crmd[14825]: 2007/09/19_15:20:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=15:0:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[14819]: 2007/09/19_15:20:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.70 cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:25 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=16:0:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[14825]: 2007/09/19_15:20:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=17:0:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[14825]: 2007/09/19_15:20:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=18:0:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[14825]: 2007/09/19_15:20:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=19:0:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[14825]: 2007/09/19_15:20:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=7) complete crmd[14825]: 2007/09/19_15:20:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[14825]: 2007/09/19_15:20:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete crmd[14825]: 2007/09/19_15:20:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete crmd[14825]: 2007/09/19_15:20:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=7) complete cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.70 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.71 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.71 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.72 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.72 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.73 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.73 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.74 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.74 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.75 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.75 cibmon[14819]: 2007/09/19_15:20:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.76 cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:26 info: log_data_element: cib_apply_diff: + lrmd[14953]: 2007/09/19_15:20:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[14825]: 2007/09/19_15:20:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=8, rc=254) Error crmd[14825]: 2007/09/19_15:20:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=7) complete crmd[14825]: 2007/09/19_15:20:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[14819]: 2007/09/19_15:20:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.76 cibmon[14819]: 2007/09/19_15:20:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.77 cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:27 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.77 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.78 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.78 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.79 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.79 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.80 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.80 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.81 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.81 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.82 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.82 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.83 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.83 cibmon[14819]: 2007/09/19_15:20:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.84 cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:20:28 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=1:1:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + lrmd[14968]: 2007/09/19_15:20:28 WARN: For LSB init script, no additional parameters are needed. cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:28 info: log_data_element: cib_apply_diff: + lrmd[14968]: 2007/09/19_15:20:28 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[14825]: 2007/09/19_15:20:28 ERROR: process_lrm_event: LRM operation mysql_stop_0 (call=10, rc=254) Error cibmon[14819]: 2007/09/19_15:20:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.84 cibmon[14819]: 2007/09/19_15:20:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.85 cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:20:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.85 cibmon[14819]: 2007/09/19_15:20:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.86 cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:20:30 info: log_data_element: cib_apply_diff: + heartbeat[15129]: 2007/09/19_15:22:07 info: No log entry found in ha.cf -- use logd heartbeat[15129]: 2007/09/19_15:22:07 info: Enabling logging daemon heartbeat[15129]: 2007/09/19_15:22:07 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[15129]: 2007/09/19_15:22:07 info: Signalling heartbeat pid 14808 to reread config files heartbeat[14808]: 2007/09/19_15:22:07 info: Configuration unchanged. heartbeat[14808]: 2007/09/19_15:25:43 info: killing /usr/lib/heartbeat/mgmtd -v process group 14826 with signal 15 mgmtd[14826]: 2007/09/19_15:25:43 info: mgmtd is shutting down heartbeat[14808]: 2007/09/19_15:25:43 info: killing /usr/lib/heartbeat/crmd process group 14825 with signal 15 crmd[14825]: 2007/09/19_15:25:43 info: crm_shutdown: Requesting shutdown crmd[14825]: 2007/09/19_15:25:43 info: do_shutdown_req: Sending shutdown request to DC: host-2.awale.qc.ca crmd[14825]: 2007/09/19_15:25:44 info: do_state_transition: State transition S_NOT_DC -> S_STOPPING [ input=I_STOP cause=C_HA_MESSAGE origin=route_message ] crmd[14825]: 2007/09/19_15:25:44 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[14825]: 2007/09/19_15:25:44 info: verify_stopped: Checking for active resources before exit cibmon[14819]: 2007/09/19_15:25:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[14819]: 2007/09/19_15:25:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.86 cibmon[14819]: 2007/09/19_15:25:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.87 cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: - crmd[14825]: 2007/09/19_15:25:44 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: - crmd[14825]: 2007/09/19_15:25:44 info: verify_stopped: Checking for active resources before exit ccm[14820]: 2007/09/19_15:25:44 info: client (pid=14825) removed from ccm cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: - cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: + cibmon[14819]: 2007/09/19_15:25:44 info: log_data_element: cib_apply_diff: + crmd[14825]: 2007/09/19_15:25:44 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. crmd[14825]: 2007/09/19_15:25:44 info: do_lrm_control: Disconnected from the LRM cib[14821]: 2007/09/19_15:25:44 WARN: send_via_callback_channel: Cannot find client for token e8489d15-d2f2-4a07-b16a-22c4312721b4 crmd[14825]: 2007/09/19_15:25:44 info: do_ha_control: Disconnected from Heartbeat cib[14821]: 2007/09/19_15:25:44 WARN: do_local_notify: A-Sync reply to 14825 failed: client left before we could send reply crmd[14825]: 2007/09/19_15:25:44 info: do_cib_control: Disconnecting CIB crmd[14825]: 2007/09/19_15:25:44 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[14825]: 2007/09/19_15:25:44 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[14825]: 2007/09/19_15:25:44 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[14825]: 2007/09/19_15:25:44 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[14825]: 2007/09/19_15:25:44 info: do_exit: [crmd] stopped (0) heartbeat[14808]: 2007/09/19_15:25:44 info: killing /usr/lib/heartbeat/attrd process group 14824 with signal 15 attrd[14824]: 2007/09/19_15:25:44 info: attrd_shutdown: Exiting attrd[14824]: 2007/09/19_15:25:44 info: main: Exiting... heartbeat[14808]: 2007/09/19_15:25:44 info: killing /usr/lib/heartbeat/stonithd process group 14823 with signal 15 stonithd[14823]: 2007/09/19_15:25:44 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[14808]: 2007/09/19_15:25:44 info: killing /usr/lib/heartbeat/lrmd -r process group 14822 with signal 15 lrmd[14822]: 2007/09/19_15:25:44 info: lrmd is shutting down heartbeat[14808]: 2007/09/19_15:25:44 info: killing /usr/lib/heartbeat/cib process group 14821 with signal 15 cib[14821]: 2007/09/19_15:25:44 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cib[14821]: 2007/09/19_15:25:44 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[14821]: 2007/09/19_15:25:44 info: cib_shutdown: Disconnected 2 clients cibmon[14819]: 2007/09/19_15:25:44 ERROR: cib_native_msgready: Message pending on command channel [14821] cib[14821]: 2007/09/19_15:25:44 info: cib_process_disconnect: All clients disconnected... cibmon[14819]: 2007/09/19_15:25:44 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[14821]: 2007/09/19_15:25:44 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[14819]: 2007/09/19_15:25:44 ERROR: MSG: No message to dump cibmon[14819]: 2007/09/19_15:25:44 info: cib_native_msgready: Lost connection to the CIB service [14821]. cibmon[14819]: 2007/09/19_15:25:44 CRIT: cib_native_dispatch: Lost connection to the CIB service [14821/callback]. cibmon[14819]: 2007/09/19_15:25:44 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[14821]: 2007/09/19_15:25:44 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[14821]: 2007/09/19_15:25:44 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[14821]: 2007/09/19_15:25:44 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[14821]: 2007/09/19_15:25:44 info: main: Done heartbeat[14808]: 2007/09/19_15:25:44 info: killing /usr/lib/heartbeat/ccm process group 14820 with signal 15 ccm[14820]: 2007/09/19_15:25:44 info: received SIGTERM, going to shut down heartbeat[14808]: 2007/09/19_15:25:44 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[14808]: 2007/09/19_15:25:45 info: killing HBFIFO process 14812 with signal 15 heartbeat[14808]: 2007/09/19_15:25:45 info: killing HBWRITE process 14813 with signal 15 heartbeat[14808]: 2007/09/19_15:25:45 info: killing HBREAD process 14814 with signal 15 heartbeat[14808]: 2007/09/19_15:25:45 info: killing HBWRITE process 14815 with signal 15 heartbeat[14808]: 2007/09/19_15:25:45 info: killing HBREAD process 14816 with signal 15 heartbeat[14808]: 2007/09/19_15:25:45 info: Core process 14812 exited. 5 remaining heartbeat[14808]: 2007/09/19_15:25:45 info: Core process 14813 exited. 4 remaining heartbeat[14808]: 2007/09/19_15:25:45 info: Core process 14815 exited. 3 remaining heartbeat[14808]: 2007/09/19_15:25:45 info: Core process 14814 exited. 2 remaining heartbeat[14808]: 2007/09/19_15:25:45 info: Core process 14816 exited. 1 remaining heartbeat[14808]: 2007/09/19_15:25:45 info: host-1.awale.qc.ca Heartbeat shutdown complete. heartbeat[15199]: 2007/09/19_15:26:26 info: No log entry found in ha.cf -- use logd heartbeat[15199]: 2007/09/19_15:26:26 info: Enabling logging daemon heartbeat[15199]: 2007/09/19_15:26:26 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[15199]: 2007/09/19_15:26:26 info: ************************** heartbeat[15199]: 2007/09/19_15:26:26 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[15200]: 2007/09/19_15:26:26 info: heartbeat: version 2.1.2 heartbeat[15200]: 2007/09/19_15:26:26 info: Heartbeat generation: 1188360845 heartbeat[15200]: 2007/09/19_15:26:26 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[15200]: 2007/09/19_15:26:26 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[15200]: 2007/09/19_15:26:26 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[15200]: 2007/09/19_15:26:26 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[15200]: 2007/09/19_15:26:26 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[15200]: 2007/09/19_15:26:26 info: glib: ping group heartbeat started. heartbeat[15200]: 2007/09/19_15:26:26 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[15200]: 2007/09/19_15:26:26 info: Local status now set to: 'up' heartbeat[15200]: 2007/09/19_15:26:28 info: Link local:local up. heartbeat[15200]: 2007/09/19_15:26:28 info: Status update for node local: status ping heartbeat[15200]: 2007/09/19_15:26:28 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[15200]: 2007/09/19_15:26:28 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[15200]: 2007/09/19_15:26:28 info: Status update for node host-2.awale.qc.ca: status active heartbeat[15200]: 2007/09/19_15:26:29 info: Comm_now_up(): updating status to active heartbeat[15200]: 2007/09/19_15:26:29 info: Local status now set to: 'active' heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) cibmon[15210]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[15210]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 15210) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[15200]: 2007/09/19_15:26:29 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[15200]: 2007/09/19_15:26:29 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 70 ms (> 50 ms) (GSource: 0x843f110) heartbeat[15211]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 15211) heartbeat[15212]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 15212) heartbeat[15213]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 15213) heartbeat[15214]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 15214) heartbeat[15216]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 15216) heartbeat[15217]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 15217) cib[15212]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[15212]: 2007/09/19_15:26:29 info: G_main_add_TriggerHandler: Added signal manual handler cib[15212]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[15212]: 2007/09/19_15:26:29 info: main: Retrieval of a per-action CIB: disabled cib[15212]: 2007/09/19_15:26:29 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml heartbeat[15215]: 2007/09/19_15:26:29 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 15215) cib[15212]: 2007/09/19_15:26:29 ERROR: validate_cib_digest: Digest comparision failed: 7191800656de80384e388f8593f3a036 vs. 45c8ab5c25d1ba320969bd028472080b cib[15212]: 2007/09/19_15:26:29 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[15212]: 2007/09/19_15:26:29 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[15212]: 2007/09/19_15:26:29 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. cib[15212]: 2007/09/19_15:26:29 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.15212 cib[15212]: 2007/09/19_15:26:29 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.15212 cib[15212]: 2007/09/19_15:26:29 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[15212]: 2007/09/19_15:26:29 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[15212]: 2007/09/19_15:26:29 WARN: validate_cib_digest: No on-disk digest present cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] ccm[15211]: 2007/09/19_15:26:29 info: Hostname: host-1.awale.qc.ca cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] lrmd[15213]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] lrmd[15213]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] lrmd[15213]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 10 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] lrmd[15213]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] lrmd[15213]: 2007/09/19_15:26:29 info: Started. cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] crmd[15216]: 2007/09/19_15:26:29 info: main: CRM Hg Version: 9a995a8a7052 tip cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] crmd[15216]: 2007/09/19_15:26:29 info: crmd_init: Starting crmd cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] crmd[15216]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] crmd[15216]: 2007/09/19_15:26:29 info: G_main_add_TriggerHandler: Added signal manual handler cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] crmd[15216]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] stonithd[15214]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 10 cib[15212]: 2007/09/19_15:26:29 info: log_data_element: readCibXmlFile: [on-disk] stonithd[15214]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[15212]: 2007/09/19_15:26:29 info: startCib: CIB Initialization completed successfully cib[15212]: 2007/09/19_15:26:29 info: cib_register_ha: Signing in with Heartbeat cib[15212]: 2007/09/19_15:26:29 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[15212]: 2007/09/19_15:26:29 WARN: cib_init: CCM Activation failed cib[15212]: 2007/09/19_15:26:29 WARN: cib_init: CCM Connection failed 1 times (30 max) stonithd[15214]: 2007/09/19_15:26:29 info: Signing in with heartbeat. attrd[15215]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[15214]: 2007/09/19_15:26:29 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[15214]: 2007/09/19_15:26:29 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[15215]: 2007/09/19_15:26:29 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[15215]: 2007/09/19_15:26:30 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[15217]: 2007/09/19_15:26:30 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[15217]: 2007/09/19_15:26:30 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[15217]: 2007/09/19_15:26:30 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[15217]: 2007/09/19_15:26:30 info: init_crm cib[15212]: 2007/09/19_15:26:30 WARN: cib_init: CCM Activation failed cib[15212]: 2007/09/19_15:26:30 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[15211]: 2007/09/19_15:26:31 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[15212]: 2007/09/19_15:26:32 info: cib_init: Starting cib mainloop cibmon[15210]: 2007/09/19_15:26:32 info: main: Starting mainloop cib[15218]: 2007/09/19_15:26:32 info: write_cib_contents: Wrote version 0.1.56 of the CIB to disk (digest: 7898f133a43f2dbdcda039d193089d55) crmd[15216]: 2007/09/19_15:26:32 info: do_cib_control: CIB connection established crmd[15216]: 2007/09/19_15:26:32 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[15212]: 2007/09/19_15:26:32 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[15212]: 2007/09/19_15:26:32 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[15212]: 2007/09/19_15:26:32 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[15212]: 2007/09/19_15:26:32 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[15212]: 2007/09/19_15:26:32 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[15212]: 2007/09/19_15:26:32 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[15216]: 2007/09/19_15:26:32 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[15217]: 2007/09/19_15:26:32 info: Started. crmd[15216]: 2007/09/19_15:26:33 info: populate_cib_nodes: Requesting the list of configured nodes cib[15212]: 2007/09/19_15:26:34 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[15212]: 2007/09/19_15:26:34 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[15212]: 2007/09/19_15:26:34 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cib[15212]: 2007/09/19_15:26:34 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:26:34 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[15216]: 2007/09/19_15:26:34 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[15216]: 2007/09/19_15:26:34 info: do_ha_control: Connected to Heartbeat crmd[15216]: 2007/09/19_15:26:34 info: do_ccm_control: CCM connection established... waiting for first callback crmd[15216]: 2007/09/19_15:26:34 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[15216]: 2007/09/19_15:26:34 info: crmd_init: Starting crmd's mainloop crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[15216]: 2007/09/19_15:26:34 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[15216]: 2007/09/19_15:26:34 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[15216]: 2007/09/19_15:26:35 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[15210]: 2007/09/19_15:26:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:26:35 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:26:35 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] crmd[15216]: 2007/09/19_15:26:35 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[15216]: 2007/09/19_15:26:35 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[15216]: 2007/09/19_15:26:35 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[15216]: 2007/09/19_15:26:35 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=4) crmd[15216]: 2007/09/19_15:26:35 info: ccm_event_detail: NEW MEMBERSHIP: trans=4, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 crmd[15216]: 2007/09/19_15:26:35 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=1] crmd[15216]: 2007/09/19_15:26:35 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=4] crmd[15216]: 2007/09/19_15:26:35 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=1] crmd[15216]: 2007/09/19_15:26:35 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=4] crmd[15216]: 2007/09/19_15:26:35 info: do_started: The local CRM is operational crmd[15216]: 2007/09/19_15:26:35 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[15216]: 2007/09/19_15:26:35 info: update_dc: Set DC to () cibmon[15210]: 2007/09/19_15:26:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:26:35 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:26:35 info: log_cib_diff: cib_update: Local-only Change: 0.1.56 cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:26:35 info: log_data_element: cib_update: + attrd[15215]: 2007/09/19_15:26:37 info: main: Starting mainloop... crmd[15216]: 2007/09/19_15:26:37 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[15216]: 2007/09/19_15:26:38 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[15216]: 2007/09/19_15:26:38 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[15212]: 2007/09/19_15:26:38 info: cib_replace_notify: Replaced: 0.1.56 -> 0.1.87 from crmd[15216]: 2007/09/19_15:26:38 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[15210]: 2007/09/19_15:26:39 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_replace: Diff: --- 0.1.56 cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_replace: Diff: +++ 0.1.87 cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cib[15222]: 2007/09/19_15:26:39 info: write_cib_contents: Wrote version 0.1.90 of the CIB to disk (digest: 5a2226022ee4c71cbb9794d3c70b9143) cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_replace: + cibmon[15210]: 2007/09/19_15:26:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.87 cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.88 cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.88 cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.89 cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.89 cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.90 cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.90 cibmon[15210]: 2007/09/19_15:26:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.91 cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:40 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[15216]: 2007/09/19_15:26:40 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=4:6:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=5:6:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.91 cibmon[15210]: 2007/09/19_15:26:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.92 cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=6:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=7:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=8:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=9:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=10:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=11:6:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:40 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=7) complete crmd[15216]: 2007/09/19_15:26:40 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete crmd[15216]: 2007/09/19_15:26:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[15216]: 2007/09/19_15:26:41 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=7) complete lrmd[15286]: 2007/09/19_15:26:41 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:26:41 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=8, rc=254) Error crmd[15216]: 2007/09/19_15:26:41 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=7) complete crmd[15216]: 2007/09/19_15:26:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete crmd[15216]: 2007/09/19_15:26:42 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[15210]: 2007/09/19_15:26:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.92 cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.93 cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.93 cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.94 cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.94 cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.95 cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:42 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=5:7:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.95 cibmon[15210]: 2007/09/19_15:26:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.96 cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.96 cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.97 cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.97 cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.98 cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.98 cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.99 cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.99 cibmon[15210]: 2007/09/19_15:26:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.100 cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:43 info: log_data_element: cib_apply_diff: + msg[15317][15338]: 2007/09/19_15:26:43 INFO Starting to switch to this node. msg[15317][15339]: 2007/09/19_15:26:43 INFO Node: host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:26:43 info: process_lrm_event: LRM operation msg_first_start_0 (call=10, rc=0) complete crmd[15216]: 2007/09/19_15:26:43 info: build_operation_update: Digest for 0:0;5:7:b20505b8-340a-4d29-b05e-b896dffe089e (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[15216]: 2007/09/19_15:26:43 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:26:44 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=6:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.100 cibmon[15210]: 2007/09/19_15:26:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.101 cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.101 cibmon[15210]: 2007/09/19_15:26:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.102 cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:44 info: log_data_element: cib_apply_diff: + msg[15349][15370]: 2007/09/19_15:26:44 INFO Starting to switch to this node. msg[15349][15371]: 2007/09/19_15:26:44 INFO Node: host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:26:45 info: process_lrm_event: LRM operation msg_first_start_0 (call=11, rc=0) complete crmd[15216]: 2007/09/19_15:26:45 info: build_operation_update: Digest for 0:0;6:8:b20505b8-340a-4d29-b05e-b896dffe089e (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[15216]: 2007/09/19_15:26:45 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:26:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=7:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.102 cibmon[15210]: 2007/09/19_15:26:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.103 cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=8:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:46 info: log_data_element: cib_apply_diff: + daemontools[15382][15398]: 2007/09/19_15:26:46 INFO Starting vmstat-mon crmd[15216]: 2007/09/19_15:26:46 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=13, rc=0) complete crmd[15216]: 2007/09/19_15:26:46 info: build_operation_update: Digest for 0:0;8:8:b20505b8-340a-4d29-b05e-b896dffe089e (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[15216]: 2007/09/19_15:26:46 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:26:46 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=12, rc=0) complete crmd[15216]: 2007/09/19_15:26:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=9:8:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:47 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=10:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.103 cibmon[15210]: 2007/09/19_15:26:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.104 cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.104 cibmon[15210]: 2007/09/19_15:26:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.105 cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:47 info: process_lrm_event: LRM operation share-drbd_start_0 (call=15, rc=0) complete crmd[15216]: 2007/09/19_15:26:47 info: build_operation_update: Digest for 0:0;10:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[15216]: 2007/09/19_15:26:47 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:26:47 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=14, rc=0) complete crmd[15216]: 2007/09/19_15:26:48 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=11:8:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:48 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=12:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.105 cibmon[15210]: 2007/09/19_15:26:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.106 cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.106 cibmon[15210]: 2007/09/19_15:26:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.107 cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:48 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=16, rc=0) complete Filesystem[15428][15460]: 2007/09/19_15:26:49 INFO: Running start for /dev/drbd0 on /share crmd[15216]: 2007/09/19_15:26:49 info: process_lrm_event: LRM operation share-FS_start_0 (call=17, rc=0) complete crmd[15216]: 2007/09/19_15:26:49 info: build_operation_update: Digest for 0:0;12:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[15216]: 2007/09/19_15:26:49 info: log_data_element: build_operation_update: digest:source cibmon[15210]: 2007/09/19_15:26:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.107 cibmon[15210]: 2007/09/19_15:26:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.108 cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=13:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:26:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=14:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.108 cibmon[15210]: 2007/09/19_15:26:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.109 cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:50 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=19, rc=0) complete crmd[15216]: 2007/09/19_15:26:50 info: build_operation_update: Digest for 0:0;14:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[15216]: 2007/09/19_15:26:50 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:26:51 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=18, rc=0) complete crmd[15216]: 2007/09/19_15:26:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=15:8:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:26:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=16:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.109 cibmon[15210]: 2007/09/19_15:26:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.110 cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=20, rc=0) complete IPaddr[15518][15550]: 2007/09/19_15:26:52 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[15518][15555]: 2007/09/19_15:26:52 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[15518][15577]: 2007/09/19_15:26:52 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[15216]: 2007/09/19_15:26:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=21, rc=0) complete crmd[15216]: 2007/09/19_15:26:52 info: build_operation_update: Digest for 0:0;16:8:b20505b8-340a-4d29-b05e-b896dffe089e (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[15216]: 2007/09/19_15:26:52 info: log_data_element: build_operation_update: digest:source cibmon[15210]: 2007/09/19_15:26:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.110 cibmon[15210]: 2007/09/19_15:26:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.111 cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.111 cibmon[15210]: 2007/09/19_15:26:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.112 cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=17:8:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:26:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.112 cibmon[15210]: 2007/09/19_15:26:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.113 cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:26:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=0) complete cibmon[15210]: 2007/09/19_15:26:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:26:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.113 cibmon[15210]: 2007/09/19_15:26:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.114 cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:26:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.114 crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.115 crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.115 cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.116 cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:9:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.116 cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.117 cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.117 cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.118 cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.118 cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.119 cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.119 cibmon[15210]: 2007/09/19_15:29:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.120 cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=23, rc=0) complete cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=25, rc=0) complete crmd[15216]: 2007/09/19_15:29:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=24, rc=0) complete crmd[15216]: 2007/09/19_15:29:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=26, rc=0) complete cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.120 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.121 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.121 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.122 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.122 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.123 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.123 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.124 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.124 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.125 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + lrmd[16244]: 2007/09/19_15:29:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=29, rc=254) Error crmd[15216]: 2007/09/19_15:29:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=27, rc=0) complete crmd[15216]: 2007/09/19_15:29:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=28, rc=0) complete crmd[15216]: 2007/09/19_15:29:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=30, rc=7) complete cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.125 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.126 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.126 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.127 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.127 cibmon[15210]: 2007/09/19_15:29:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.128 cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:10:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:29:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:10:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.128 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.129 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.129 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.130 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:10:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.130 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.131 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.131 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.132 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.132 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.133 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.133 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.134 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.134 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.135 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:10:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.135 cibmon[15210]: 2007/09/19_15:29:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.136 cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:45 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:10:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:29:45 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:10:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:29:45 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:10:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:29:45 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:10:b20505b8-340a-4d29-b05e-b896dffe089e) crmd[15216]: 2007/09/19_15:29:45 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=33, rc=0) complete crmd[15216]: 2007/09/19_15:29:45 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=32, rc=0) complete crmd[15216]: 2007/09/19_15:29:45 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=31, rc=0) complete crmd[15216]: 2007/09/19_15:29:45 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=34, rc=0) complete cibmon[15210]: 2007/09/19_15:29:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.136 cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.137 cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.137 cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.138 cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.138 cibmon[15210]: 2007/09/19_15:29:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.139 cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:45 info: log_data_element: cib_apply_diff: + lrmd[16352]: 2007/09/19_15:29:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:46 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=37, rc=254) Error crmd[15216]: 2007/09/19_15:29:46 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=35, rc=0) complete crmd[15216]: 2007/09/19_15:29:46 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=36, rc=0) complete crmd[15216]: 2007/09/19_15:29:46 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=38, rc=7) complete cibmon[15210]: 2007/09/19_15:29:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.139 cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.140 cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.140 cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.141 cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.141 cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.142 cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.142 cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.143 cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.143 cibmon[15210]: 2007/09/19_15:29:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.144 cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.144 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.145 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.145 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.146 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:47 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:11:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:29:47 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=41, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.146 crmd[15216]: 2007/09/19_15:29:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=43, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.147 crmd[15216]: 2007/09/19_15:29:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=40, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=39, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=42, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.147 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.148 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - lrmd[16471]: 2007/09/19_15:29:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=44, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=45, rc=254) Error cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=46, rc=7) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.148 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.149 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.149 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.150 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.150 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.151 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.151 cibmon[15210]: 2007/09/19_15:29:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.152 cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:12:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=49, rc=0) complete cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.152 cibmon[15210]: 2007/09/19_15:29:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.153 cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + lrmd[16556]: 2007/09/19_15:29:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=48, rc=0) complete cibmon[15210]: 2007/09/19_15:29:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=47, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:29:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=50, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.153 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.154 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.154 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.155 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=53, rc=254) Error cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=51, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=54, rc=7) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=52, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.155 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.156 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.156 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.157 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.157 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.158 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - lrmd[16666]: 2007/09/19_15:29:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=56, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=57, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=55, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:13:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=58, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=62, rc=7) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=61, rc=254) Error cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.158 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.159 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=59, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=60, rc=0) complete cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:54 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.159 cibmon[15210]: 2007/09/19_15:29:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.160 cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:54 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.160 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.161 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:54 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:29:55 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:29:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + lrmd[16759]: 2007/09/19_15:29:56 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:14:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=65, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=66, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:55 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=64, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:29:55 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=63, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.161 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.162 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.162 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.163 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.163 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.164 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:56 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=69, rc=254) Error cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:56 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=67, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:56 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=70, rc=7) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=68, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.164 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.165 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.165 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.166 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.166 cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.167 cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[16858]: 2007/09/19_15:29:58 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.167 crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.168 crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:15:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=73, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=72, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=71, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:57 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=74, rc=0) complete cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:58 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=77, rc=254) Error cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.168 cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.169 cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.169 cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.170 cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=75, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=76, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:58 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=78, rc=7) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.170 cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.171 cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.171 cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.172 cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.172 cibmon[15210]: 2007/09/19_15:29:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.173 cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:16:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=81, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:29:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=83, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=80, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:29:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=79, rc=0) complete cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.173 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.174 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + lrmd[16967]: 2007/09/19_15:30:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:29:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=82, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=85, rc=254) Error cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:00 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=84, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.174 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.175 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:00 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=86, rc=7) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.175 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.176 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:17:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=89, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.176 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.177 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.177 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.178 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=88, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - lrmd[17060]: 2007/09/19_15:30:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=87, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=90, rc=0) complete cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.178 cibmon[15210]: 2007/09/19_15:29:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.179 cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.179 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.180 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - logd[14786]: 2007/09/19_15:30:11 WARN: G_CH_prepare_int: working on IPC channel took 190 ms (> 100 ms) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=93, rc=254) Error cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.180 crmd[15216]: 2007/09/19_15:30:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=91, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.181 crmd[15216]: 2007/09/19_15:30:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=94, rc=7) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=92, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.181 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.182 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.182 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.183 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + lrmd[17154]: 2007/09/19_15:30:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:18:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=97, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=96, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=95, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=98, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.183 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.184 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=101, rc=254) Error cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.184 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.185 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=99, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=100, rc=0) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=102, rc=7) complete cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.185 cibmon[15210]: 2007/09/19_15:29:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.186 cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.186 cibmon[15210]: 2007/09/19_15:29:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.187 cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - lrmd[17262]: 2007/09/19_15:30:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=105, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=104, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=103, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=106, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:19:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=109, rc=254) Error cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=107, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=108, rc=0) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=110, rc=7) complete cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.187 cibmon[15210]: 2007/09/19_15:29:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.188 cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.188 cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.189 cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:30:08 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 700 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:30:08 info: G_SIG_dispatch: started at 430058242 should have started at 430058172 crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:20:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=113, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=114, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=112, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=111, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.189 cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.190 cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + lrmd[17356]: 2007/09/19_15:30:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=117, rc=254) Error cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=115, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=118, rc=7) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.190 crmd[15216]: 2007/09/19_15:30:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=116, rc=0) complete cibmon[15210]: 2007/09/19_15:29:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.191 cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 ERROR: cl_log: 268 messages were dropped cibmon[15210]: 2007/09/19_15:29:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.200 cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.201 cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.201 cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.202 cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.202 cibmon[15210]: 2007/09/19_15:29:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.203 cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:29:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.208 cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.209 cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + lrmd[17466]: 2007/09/19_15:30:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:21:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=121, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=120, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=119, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=122, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.209 cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.210 cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=125, rc=254) Error cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=123, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=126, rc=7) complete cibmon[15210]: 2007/09/19_15:29:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=124, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.210 cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.211 cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.211 cibmon[15210]: 2007/09/19_15:29:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.212 cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - lrmd[17561]: 2007/09/19_15:30:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:22:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=129, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=131, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=128, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=127, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:12 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=130, rc=0) complete cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:29:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.216 cibmon[15210]: 2007/09/19_15:29:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.217 cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.217 cibmon[15210]: 2007/09/19_15:29:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.218 cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=133, rc=254) Error cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=132, rc=0) complete cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:13 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=134, rc=7) complete cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:29:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.224 cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.225 cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:29:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.225 cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.226 cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - lrmd[17650]: 2007/09/19_15:30:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:23:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=135, rc=0) complete cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=137, rc=0) complete cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=136, rc=0) complete cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:15 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=140, rc=0) complete cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:29:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.226 cibmon[15210]: 2007/09/19_15:29:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.227 cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:29:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:30:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=141, rc=254) Error cibmon[15210]: 2007/09/19_15:30:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=139, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.228 crmd[15216]: 2007/09/19_15:30:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=142, rc=7) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.229 crmd[15216]: 2007/09/19_15:30:16 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=138, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:30:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.233 cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.234 cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=145, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=144, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.234 crmd[15216]: 2007/09/19_15:30:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=143, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.235 crmd[15216]: 2007/09/19_15:30:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=146, rc=0) complete cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 ERROR: cl_log: 292 messages were dropped cibmon[15210]: 2007/09/19_15:30:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.245 cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.246 cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - lrmd[17760]: 2007/09/19_15:30:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:24:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=149, rc=254) Error cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=150, rc=7) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=147, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=148, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.246 cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.247 cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:30:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[17884]: 2007/09/19_15:30:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:19 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=152, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.248 crmd[15216]: 2007/09/19_15:30:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=151, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.249 crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:25:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=153, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=155, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=156, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=154, rc=0) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=157, rc=254) Error cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.249 cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.250 cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=158, rc=7) complete cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.250 cibmon[15210]: 2007/09/19_15:30:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.251 cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 ERROR: cl_log: 174 messages were dropped cibmon[15210]: 2007/09/19_15:30:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.257 cibmon[15210]: 2007/09/19_15:30:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.258 cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=160, rc=0) complete cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=159, rc=0) complete cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.258 cibmon[15210]: 2007/09/19_15:30:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.259 cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:30:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[17979]: 2007/09/19_15:30:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.264 crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.265 crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:26:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=161, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=163, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=164, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=162, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=165, rc=254) Error cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=166, rc=7) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:27:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=169, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=168, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=167, rc=0) complete cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.265 cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.266 cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - lrmd[18074]: 2007/09/19_15:30:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=170, rc=0) complete cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=173, rc=254) Error cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=171, rc=0) complete cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=174, rc=7) complete cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=172, rc=0) complete cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:30:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.272 cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.273 cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:30:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.273 crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.274 crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:28:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=177, rc=0) complete cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:30:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.283 cibmon[15210]: 2007/09/19_15:30:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.284 cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + lrmd[18168]: 2007/09/19_15:30:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=178, rc=0) complete cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:29 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=175, rc=0) complete cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:29 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=176, rc=0) complete cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.284 cibmon[15210]: 2007/09/19_15:30:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.285 cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 ERROR: cl_log: 350 messages were dropped cibmon[15210]: 2007/09/19_15:30:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.297 cibmon[15210]: 2007/09/19_15:30:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.298 cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=181, rc=254) Error cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=179, rc=0) complete cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=180, rc=0) complete cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=182, rc=7) complete cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.298 cibmon[15210]: 2007/09/19_15:30:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.299 cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:30:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.307 cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.308 cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.308 cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.309 cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.309 cibmon[15210]: 2007/09/19_15:30:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.310 cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - lrmd[18276]: 2007/09/19_15:30:32 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:29:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=184, rc=0) complete cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=185, rc=0) complete cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=186, rc=0) complete cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=183, rc=0) complete cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.310 cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.311 cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:30:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.314 cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.315 cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=187, rc=0) complete cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=189, rc=254) Error cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=188, rc=0) complete cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=190, rc=7) complete cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.315 cibmon[15210]: 2007/09/19_15:30:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.316 cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:30:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.320 cibmon[15210]: 2007/09/19_15:30:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.321 cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 ERROR: cl_log: 437 messages were dropped cibmon[15210]: 2007/09/19_15:30:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.336 cibmon[15210]: 2007/09/19_15:30:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.337 cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.337 cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.338 cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.338 cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.339 cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - lrmd[18372]: 2007/09/19_15:30:35 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:30:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=191, rc=0) complete cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=193, rc=0) complete cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=192, rc=0) complete cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=194, rc=0) complete cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.339 cibmon[15210]: 2007/09/19_15:30:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.340 cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:30:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.344 cibmon[15210]: 2007/09/19_15:30:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.345 cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.345 cibmon[15210]: 2007/09/19_15:30:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.346 cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:30:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.352 cibmon[15210]: 2007/09/19_15:30:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.353 cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:35 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=195, rc=0) complete cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=197, rc=254) Error cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=196, rc=0) complete cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=198, rc=7) complete cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:30:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.356 cibmon[15210]: 2007/09/19_15:30:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.357 cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + lrmd[18482]: 2007/09/19_15:30:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.357 crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.358 crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:31:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=201, rc=0) complete cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:37 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=200, rc=0) complete cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:37 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=199, rc=0) complete cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:37 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=202, rc=0) complete cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 ERROR: cl_log: 320 messages were dropped cibmon[15210]: 2007/09/19_15:30:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.369 cibmon[15210]: 2007/09/19_15:30:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.370 cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=205, rc=254) Error cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=203, rc=0) complete cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=204, rc=0) complete cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=206, rc=7) complete cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.370 cibmon[15210]: 2007/09/19_15:30:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.371 cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 ERROR: cl_log: 320 messages were dropped cibmon[15210]: 2007/09/19_15:30:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.382 cibmon[15210]: 2007/09/19_15:30:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.383 cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - lrmd[18576]: 2007/09/19_15:30:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:32:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=209, rc=0) complete cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=208, rc=0) complete cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:38 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=207, rc=0) complete cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=210, rc=0) complete cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:30:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.386 cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.387 cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.387 cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.388 cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=213, rc=254) Error cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:39 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=211, rc=0) complete cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=212, rc=0) complete cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=214, rc=7) complete cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:30:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.389 cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.390 cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.390 cibmon[15210]: 2007/09/19_15:30:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.391 cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 ERROR: cl_log: 494 messages were dropped cibmon[15210]: 2007/09/19_15:30:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.408 cibmon[15210]: 2007/09/19_15:30:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.409 cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:30:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.415 cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.416 cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.416 cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.417 cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - lrmd[18684]: 2007/09/19_15:30:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:33:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=216, rc=0) complete cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=217, rc=0) complete cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=215, rc=0) complete cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=218, rc=0) complete cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=221, rc=254) Error cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:30:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.421 cibmon[15210]: 2007/09/19_15:30:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.422 cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:30:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.429 cibmon[15210]: 2007/09/19_15:30:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.430 cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.430 cibmon[15210]: 2007/09/19_15:30:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.431 cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=219, rc=0) complete cibmon[15210]: 2007/09/19_15:30:31 ERROR: cl_log: 31 messages were dropped crmd[15216]: 2007/09/19_15:30:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=220, rc=0) complete cibmon[15210]: 2007/09/19_15:30:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=222, rc=7) complete cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.432 cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.433 cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.433 cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.434 cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.434 cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.435 cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.435 cibmon[15210]: 2007/09/19_15:30:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.436 cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + lrmd[18778]: 2007/09/19_15:30:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:32 ERROR: cl_log: 117 messages were dropped crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:34:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.440 crmd[15216]: 2007/09/19_15:30:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=225, rc=0) complete cibmon[15210]: 2007/09/19_15:30:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.441 crmd[15216]: 2007/09/19_15:30:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=226, rc=0) complete cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=223, rc=0) complete cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=224, rc=0) complete cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=229, rc=254) Error cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.441 cibmon[15210]: 2007/09/19_15:30:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.442 cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:30:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.448 cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.449 cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=227, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=230, rc=7) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=228, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.449 cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.450 cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.450 cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.451 cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.451 crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.452 crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:35:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=232, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=231, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=233, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:47 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=234, rc=0) complete cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.452 cibmon[15210]: 2007/09/19_15:30:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.453 cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + lrmd[18911]: 2007/09/19_15:30:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 ERROR: cl_log: 205 messages were dropped cibmon[15210]: 2007/09/19_15:30:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.460 cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.461 cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.461 cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.462 cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.462 cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.463 cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=235, rc=0) complete cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=237, rc=254) Error cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:48 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=238, rc=7) complete cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=236, rc=0) complete cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.463 cibmon[15210]: 2007/09/19_15:30:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.464 cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:30:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.464 cibmon[15210]: 2007/09/19_15:30:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.465 cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 ERROR: cl_log: 320 messages were dropped cibmon[15210]: 2007/09/19_15:30:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.476 cibmon[15210]: 2007/09/19_15:30:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.477 cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:30:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.477 cibmon[15210]: 2007/09/19_15:30:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.478 cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:30:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.478 cibmon[15210]: 2007/09/19_15:30:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.479 crmd[15216]: 2007/09/19_15:30:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:30:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.479 cibmon[15210]: 2007/09/19_15:30:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.480 cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:30:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.489 cibmon[15210]: 2007/09/19_15:30:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.490 cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - lrmd[19009]: 2007/09/19_15:30:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:36:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=240, rc=0) complete cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=241, rc=0) complete cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=239, rc=0) complete cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:50 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=242, rc=0) complete cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.490 cibmon[15210]: 2007/09/19_15:30:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.491 cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:30:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.496 cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.497 cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.497 cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.498 cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=245, rc=254) Error cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=244, rc=0) complete cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=243, rc=0) complete cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:51 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=246, rc=7) complete cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.498 cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.499 cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.499 cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.500 cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.500 cibmon[15210]: 2007/09/19_15:30:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.501 cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 ERROR: cl_log: 205 messages were dropped cibmon[15210]: 2007/09/19_15:30:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.508 cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.509 cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.509 cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.510 cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.510 cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.511 crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.511 cibmon[15210]: 2007/09/19_15:30:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.512 cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:37:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=249, rc=0) complete cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=248, rc=0) complete cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=247, rc=0) complete cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=250, rc=0) complete cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:30:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.512 cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.513 cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[19151]: 2007/09/19_15:30:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.513 cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.514 cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=253, rc=254) Error cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.514 cibmon[15210]: 2007/09/19_15:30:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.515 cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 ERROR: cl_log: 263 messages were dropped cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.524 cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.525 cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=251, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=254, rc=7) complete cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=252, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.525 cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.526 cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.526 cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.527 cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 ERROR: cl_log: 32 messages were dropped cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.528 cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.529 cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.529 crmd[15216]: 2007/09/19_15:30:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:38:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.530 crmd[15216]: 2007/09/19_15:30:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=256, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=257, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=255, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=258, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=260, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.530 cibmon[15210]: 2007/09/19_15:30:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.531 cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - lrmd[19272]: 2007/09/19_15:30:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=259, rc=0) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=261, rc=254) Error cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=262, rc=7) complete cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:30:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.536 cibmon[15210]: 2007/09/19_15:30:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.537 cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.544 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.545 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:39:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=265, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=264, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.545 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.546 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + lrmd[19355]: 2007/09/19_15:30:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:30:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=263, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:30:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=266, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.546 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.547 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.547 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.548 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=269, rc=254) Error cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=267, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=268, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:30:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=270, rc=7) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.548 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.549 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.549 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.550 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:40:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=273, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.550 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.551 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + lrmd[19476]: 2007/09/19_15:31:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=272, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=271, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=274, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=276, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=277, rc=254) Error cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=275, rc=0) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=278, rc=7) complete cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.551 cibmon[15210]: 2007/09/19_15:30:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.552 cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.552 cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.553 cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:41:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.553 cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.554 cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - lrmd[19557]: 2007/09/19_15:31:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=280, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=281, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=279, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=282, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.554 cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.555 cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=285, rc=254) Error cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=283, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=284, rc=0) complete cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=286, rc=7) complete cibmon[15210]: 2007/09/19_15:30:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.555 cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.556 cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.556 cibmon[15210]: 2007/09/19_15:30:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.557 cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.561 cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.562 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + lrmd[19652]: 2007/09/19_15:31:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:42:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=289, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=288, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=287, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.562 crmd[15216]: 2007/09/19_15:31:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=290, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.563 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.563 cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.564 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.564 cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.565 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=293, rc=254) Error cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=292, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=291, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=294, rc=7) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.565 cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.566 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.566 cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.567 cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + lrmd[19762]: 2007/09/19_15:31:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:43:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.567 crmd[15216]: 2007/09/19_15:31:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=297, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.568 crmd[15216]: 2007/09/19_15:31:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=296, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=295, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=298, rc=0) complete cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.568 cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.569 cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=301, rc=254) Error cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.569 cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.570 cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.570 cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.571 cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=299, rc=0) complete cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=302, rc=7) complete cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=300, rc=0) complete cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.571 cibmon[15210]: 2007/09/19_15:30:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.572 cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.572 cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.573 cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 ERROR: cl_log: 206 messages were dropped cibmon[15210]: 2007/09/19_15:30:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.580 cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.581 cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - lrmd[19856]: 2007/09/19_15:31:10 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:44:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=305, rc=0) complete cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=304, rc=0) complete cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=303, rc=0) complete cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:09 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=306, rc=0) complete cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:10 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=309, rc=254) Error cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.581 cibmon[15210]: 2007/09/19_15:30:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.582 cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:30:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.584 cibmon[15210]: 2007/09/19_15:30:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.585 cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.585 cibmon[15210]: 2007/09/19_15:30:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.586 cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:10 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=307, rc=0) complete cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:10 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=308, rc=0) complete cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:10 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=310, rc=7) complete cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:30:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.592 cibmon[15210]: 2007/09/19_15:30:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.593 cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.593 cibmon[15210]: 2007/09/19_15:30:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.594 cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=312, rc=0) complete cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=313, rc=0) complete cibmon[15210]: 2007/09/19_15:30:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=311, rc=0) complete cibmon[15210]: 2007/09/19_15:30:59 ERROR: cl_log: 204 messages were dropped crmd[15216]: 2007/09/19_15:31:12 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=316, rc=0) complete cibmon[15210]: 2007/09/19_15:30:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:45:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.601 crmd[15216]: 2007/09/19_15:31:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=318, rc=7) complete cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.602 cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:30:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.604 cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.605 cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - lrmd[19963]: 2007/09/19_15:31:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=317, rc=254) Error cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=315, rc=0) complete cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:13 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=314, rc=0) complete cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.605 cibmon[15210]: 2007/09/19_15:30:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.606 cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:30:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:31:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.608 cibmon[15210]: 2007/09/19_15:31:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.609 cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.609 cibmon[15210]: 2007/09/19_15:31:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.610 cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:31:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.616 cibmon[15210]: 2007/09/19_15:31:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.617 cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:31:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.625 cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.626 cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + lrmd[20060]: 2007/09/19_15:31:15 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 ERROR: cl_log: 31 messages were dropped crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:14 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:46:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.627 crmd[15216]: 2007/09/19_15:31:14 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=321, rc=0) complete cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.628 crmd[15216]: 2007/09/19_15:31:14 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=320, rc=0) complete cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:14 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=319, rc=0) complete cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:14 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=322, rc=0) complete cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:31:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.628 cibmon[15210]: 2007/09/19_15:31:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.629 cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:31:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.633 cibmon[15210]: 2007/09/19_15:31:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.634 cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.634 cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.635 cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:15 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=325, rc=254) Error cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:15 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=323, rc=0) complete cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:15 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=326, rc=7) complete cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:15 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=324, rc=0) complete cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:31:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.640 cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.641 cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:31:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.641 cibmon[15210]: 2007/09/19_15:31:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.642 cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.649 cibmon[15210]: 2007/09/19_15:31:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.650 cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.650 cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.651 cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:31:17 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:47:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=329, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=327, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=328, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=330, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.651 cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.652 cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + lrmd[20154]: 2007/09/19_15:31:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:31:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.656 cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.657 cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:31:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.658 cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.659 cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=333, rc=254) Error cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=331, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=332, rc=0) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=334, rc=7) complete cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.659 cibmon[15210]: 2007/09/19_15:31:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.660 cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.664 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.665 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.665 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.666 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.666 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.667 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:48:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=337, rc=0) complete cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:19 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=336, rc=0) complete cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.673 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.674 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 ERROR: cl_log: 1 messages were dropped lrmd[20262]: 2007/09/19_15:31:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=335, rc=0) complete cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:19 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=338, rc=0) complete cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.674 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.675 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.675 cibmon[15210]: 2007/09/19_15:31:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.676 cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=341, rc=254) Error cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=339, rc=0) complete cibmon[15210]: 2007/09/19_15:31:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=340, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 ERROR: cl_log: 117 messages were dropped crmd[15216]: 2007/09/19_15:31:20 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=342, rc=7) complete cibmon[15210]: 2007/09/19_15:31:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.680 cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.681 cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.681 cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.682 cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.682 crmd[15216]: 2007/09/19_15:31:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.683 cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - lrmd[20355]: 2007/09/19_15:31:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=345, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=344, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=343, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=346, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:49:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=349, rc=254) Error cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=350, rc=7) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=348, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=347, rc=0) complete cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.683 cibmon[15210]: 2007/09/19_15:31:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.684 cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:31:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.688 cibmon[15210]: 2007/09/19_15:31:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.689 cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:31:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.698 cibmon[15210]: 2007/09/19_15:31:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.699 cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.699 cibmon[15210]: 2007/09/19_15:31:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.700 cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 ERROR: cl_log: 117 messages were dropped lrmd[20467]: 2007/09/19_15:31:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.704 crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.705 crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:50:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=353, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=352, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=351, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=354, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=357, rc=254) Error cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.705 cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.706 cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:31:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.706 cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.707 cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cib[20463]: 2007/09/19_15:31:25 info: write_cib_contents: Wrote version 0.2.1 of the CIB to disk (digest: 94b54df4b914c0b7d813cb39c37987c4) crmd[15216]: 2007/09/19_15:31:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=355, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=358, rc=7) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=356, rc=0) complete cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.707 cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.708 cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.708 cibmon[15210]: 2007/09/19_15:31:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.709 cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:31:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.718 cibmon[15210]: 2007/09/19_15:31:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.719 cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - lrmd[20562]: 2007/09/19_15:31:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:51:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=361, rc=0) complete cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=359, rc=0) complete cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=360, rc=0) complete cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=363, rc=0) complete cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=362, rc=0) complete cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.719 cibmon[15210]: 2007/09/19_15:31:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.720 cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.720 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.721 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=365, rc=254) Error cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=366, rc=7) complete cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=364, rc=0) complete cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.721 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.722 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.722 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.723 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.723 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.724 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.724 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.725 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.725 cibmon[15210]: 2007/09/19_15:31:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.726 cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:31:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.728 cibmon[15210]: 2007/09/19_15:31:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.729 cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:31:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.731 cibmon[15210]: 2007/09/19_15:31:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.732 cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.732 cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.733 cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - lrmd[20671]: 2007/09/19_15:31:30 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:52:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=368, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=369, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:29 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=367, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=370, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:31:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.736 cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.737 crmd[15216]: 2007/09/19_15:31:30 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=373, rc=254) Error cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:30 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=371, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=372, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=374, rc=7) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=376, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.737 crmd[15216]: 2007/09/19_15:31:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=375, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.738 cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.738 cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.739 cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + lrmd[20742]: 2007/09/19_15:31:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:53:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=377, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=381, rc=254) Error cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=379, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=382, rc=7) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=380, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=378, rc=0) complete cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.739 cibmon[15210]: 2007/09/19_15:31:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.740 cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 ERROR: cl_log: 4 messages were dropped cibmon[15210]: 2007/09/19_15:31:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.740 crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.741 crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:54:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=385, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=384, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=383, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:33 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=386, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:33 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=388, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.741 cibmon[15210]: 2007/09/19_15:31:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.742 cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + lrmd[20886]: 2007/09/19_15:31:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:33 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=389, rc=254) Error cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=387, rc=0) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:34 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=390, rc=7) complete cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:31:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.744 cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.745 cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.745 cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.746 cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:55:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=393, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=392, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=391, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=394, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=395, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.753 cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.754 cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + lrmd[20969]: 2007/09/19_15:31:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=397, rc=254) Error cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=398, rc=7) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:36 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=396, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:37 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=400, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:31:37 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=399, rc=0) complete cibmon[15210]: 2007/09/19_15:31:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.754 crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.755 crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:37 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.762 cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.763 cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - lrmd[21041]: 2007/09/19_15:31:38 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:56:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - lrmd[21169]: 2007/09/19_15:31:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=401, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:38 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=405, rc=254) Error cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:38 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=403, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:38 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=404, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=406, rc=7) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:38 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=402, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:57:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=408, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=409, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=407, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=410, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:40 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=413, rc=254) Error cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.763 cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.764 cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.764 cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.765 cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=411, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=414, rc=7) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=412, rc=0) complete cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.772 cibmon[15210]: 2007/09/19_15:31:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.773 cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.773 cibmon[15210]: 2007/09/19_15:31:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.774 cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:58:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=416, rc=0) complete cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=417, rc=0) complete cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=418, rc=0) complete cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 ERROR: cl_log: 110 messages were dropped cibmon[15210]: 2007/09/19_15:31:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1 cibmon[15210]: 2007/09/19_15:31:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2 cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=415, rc=0) complete cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + lrmd[21263]: 2007/09/19_15:31:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=421, rc=254) Error cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=419, rc=0) complete cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=422, rc=7) complete cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=420, rc=0) complete cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2 cibmon[15210]: 2007/09/19_15:31:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.3 cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:31:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.8 cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.9 cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.9 cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.10 cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.10 cibmon[15210]: 2007/09/19_15:31:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.11 cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - lrmd[21374]: 2007/09/19_15:31:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:59:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=425, rc=0) complete cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=426, rc=0) complete cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=424, rc=0) complete cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=423, rc=0) complete cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 ERROR: cl_log: 320 messages were dropped cibmon[15210]: 2007/09/19_15:31:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.22 cibmon[15210]: 2007/09/19_15:31:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.23 cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=429, rc=254) Error cibmon[15210]: 2007/09/19_15:31:27 ERROR: cl_log: 31 messages were dropped crmd[15216]: 2007/09/19_15:31:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=427, rc=0) complete cibmon[15210]: 2007/09/19_15:31:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=430, rc=7) complete cibmon[15210]: 2007/09/19_15:31:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.24 crmd[15216]: 2007/09/19_15:31:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=428, rc=0) complete cibmon[15210]: 2007/09/19_15:31:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.25 cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.25 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.26 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.26 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.27 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.27 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.28 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.28 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.29 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.29 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.30 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + lrmd[21467]: 2007/09/19_15:31:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:47 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:60:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=432, rc=0) complete cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:48 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=433, rc=0) complete cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=431, rc=0) complete cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=434, rc=0) complete cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.30 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.31 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=437, rc=254) Error cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.31 cibmon[15210]: 2007/09/19_15:31:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.32 cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.32 cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.33 cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:49 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=435, rc=0) complete cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=438, rc=7) complete cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=436, rc=0) complete cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.33 cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.34 cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.34 cibmon[15210]: 2007/09/19_15:31:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.35 cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 ERROR: cl_log: 265 messages were dropped cibmon[15210]: 2007/09/19_15:31:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.44 cibmon[15210]: 2007/09/19_15:31:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.45 cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:31:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.48 cibmon[15210]: 2007/09/19_15:31:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.49 cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:31:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.49 cibmon[15210]: 2007/09/19_15:31:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.50 cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 ERROR: cl_log: 407 messages were dropped crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.64 crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.65 crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:61:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=440, rc=0) complete cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=441, rc=0) complete cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:50 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=439, rc=0) complete cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.72 cibmon[15210]: 2007/09/19_15:31:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.73 cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + lrmd[21575]: 2007/09/19_15:31:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:50 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=442, rc=0) complete cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.73 cibmon[15210]: 2007/09/19_15:31:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.74 cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:31:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.80 cibmon[15210]: 2007/09/19_15:31:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.81 cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=445, rc=254) Error cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=443, rc=0) complete cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=444, rc=0) complete cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:51 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=446, rc=7) complete cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 ERROR: cl_log: 437 messages were dropped cibmon[15210]: 2007/09/19_15:31:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.96 cibmon[15210]: 2007/09/19_15:31:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.97 cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.97 cibmon[15210]: 2007/09/19_15:31:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.98 cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:62:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=448, rc=0) complete cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 ERROR: cl_log: 437 messages were dropped cibmon[15210]: 2007/09/19_15:31:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.113 cibmon[15210]: 2007/09/19_15:31:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.114 cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[21669]: 2007/09/19_15:31:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=449, rc=0) complete cibmon[15210]: 2007/09/19_15:31:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.114 crmd[15216]: 2007/09/19_15:31:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=447, rc=0) complete cibmon[15210]: 2007/09/19_15:31:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.115 crmd[15216]: 2007/09/19_15:31:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=450, rc=0) complete cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:31:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.120 cibmon[15210]: 2007/09/19_15:31:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.121 cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=453, rc=254) Error cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=451, rc=0) complete cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=454, rc=7) complete cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=452, rc=0) complete cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.121 cibmon[15210]: 2007/09/19_15:31:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.122 cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:31:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.128 cibmon[15210]: 2007/09/19_15:31:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.129 cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:31:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.136 cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.137 cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:63:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=457, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=455, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=456, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:55 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=458, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.137 cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.138 cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.138 cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.139 cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - lrmd[21777]: 2007/09/19_15:31:56 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:56 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=461, rc=254) Error cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:56 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=459, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:56 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=462, rc=7) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=460, rc=0) complete cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.139 cibmon[15210]: 2007/09/19_15:31:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.140 cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 ERROR: cl_log: 350 messages were dropped cibmon[15210]: 2007/09/19_15:31:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.152 cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.153 cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.153 cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.154 cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.154 cibmon[15210]: 2007/09/19_15:31:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.155 cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:31:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:31:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.155 crmd[15216]: 2007/09/19_15:31:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.156 crmd[15216]: 2007/09/19_15:31:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:64:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=465, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=464, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=467, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=463, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=466, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.156 cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.157 cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - lrmd[21872]: 2007/09/19_15:31:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:31:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=469, rc=254) Error cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=468, rc=0) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.157 cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.158 cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.158 cibmon[15210]: 2007/09/19_15:31:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.159 cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=470, rc=7) complete cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:31:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:31:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.160 cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.161 cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.161 lrmd[21979]: 2007/09/19_15:32:01 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.162 crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:65:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=473, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=472, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=471, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=474, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:01 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=477, rc=254) Error cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:01 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=475, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=478, rc=7) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=476, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.162 cibmon[15210]: 2007/09/19_15:31:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.163 cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: - lrmd[22075]: 2007/09/19_15:32:03 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:66:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=480, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=481, rc=0) complete cibmon[15210]: 2007/09/19_15:31:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:02 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=479, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 ERROR: cl_log: 148 messages were dropped crmd[15216]: 2007/09/19_15:32:02 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=482, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.168 cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.169 cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:03 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=485, rc=254) Error cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.169 cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.170 cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:03 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=483, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:03 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=486, rc=7) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:03 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=484, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.170 cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.171 cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.171 cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.172 cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + lrmd[22183]: 2007/09/19_15:32:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.172 crmd[15216]: 2007/09/19_15:32:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:67:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.173 crmd[15216]: 2007/09/19_15:32:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=490, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=489, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=488, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=487, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=493, rc=254) Error cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=491, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.173 cibmon[15210]: 2007/09/19_15:31:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.174 cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - lrmd[22277]: 2007/09/19_15:32:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=492, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=494, rc=7) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:68:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=497, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=496, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=495, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=498, rc=0) complete cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:31:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.176 cibmon[15210]: 2007/09/19_15:31:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.177 cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=501, rc=254) Error cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=499, rc=0) complete cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=500, rc=0) complete cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=502, rc=7) complete cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:31:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.180 cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.181 cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.181 cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.182 cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:31:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.185 cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.186 cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.186 cibmon[15210]: 2007/09/19_15:31:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.187 cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:31:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.191 cibmon[15210]: 2007/09/19_15:31:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.192 cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.192 cibmon[15210]: 2007/09/19_15:31:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.193 cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - lrmd[22385]: 2007/09/19_15:32:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:69:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=505, rc=0) complete cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=504, rc=0) complete cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=503, rc=0) complete cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=506, rc=0) complete cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=509, rc=254) Error cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:31:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.197 cibmon[15210]: 2007/09/19_15:31:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.198 cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=507, rc=0) complete cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=508, rc=0) complete cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=510, rc=7) complete cibmon[15210]: 2007/09/19_15:31:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:31:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.200 cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.201 cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.201 cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.202 cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.202 cibmon[15210]: 2007/09/19_15:31:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.203 cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + lrmd[22481]: 2007/09/19_15:32:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:70:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:13 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=512, rc=0) complete cibmon[15210]: 2007/09/19_15:31:56 ERROR: cl_log: 118 messages were dropped crmd[15216]: 2007/09/19_15:32:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=513, rc=0) complete cibmon[15210]: 2007/09/19_15:31:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=511, rc=0) complete cibmon[15210]: 2007/09/19_15:31:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.207 crmd[15216]: 2007/09/19_15:32:13 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=514, rc=0) complete cibmon[15210]: 2007/09/19_15:31:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.208 cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.208 cibmon[15210]: 2007/09/19_15:31:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.209 cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:31:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.210 cibmon[15210]: 2007/09/19_15:31:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.211 cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=517, rc=254) Error cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=515, rc=0) complete cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=516, rc=0) complete cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=518, rc=7) complete cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.211 cibmon[15210]: 2007/09/19_15:31:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.212 cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:31:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.218 cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.219 cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.219 cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.220 cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.220 cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.221 cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + lrmd[22589]: 2007/09/19_15:32:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 ERROR: cl_log: 60 messages were dropped crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.223 crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.224 crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:71:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=520, rc=0) complete cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=521, rc=0) complete cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=519, rc=0) complete cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=522, rc=0) complete cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:31:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.228 cibmon[15210]: 2007/09/19_15:31:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.229 cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=525, rc=254) Error cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=523, rc=0) complete cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=526, rc=7) complete cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=524, rc=0) complete cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:31:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.229 cibmon[15210]: 2007/09/19_15:31:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.230 cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:31:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.230 cibmon[15210]: 2007/09/19_15:32:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.231 cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.231 cibmon[15210]: 2007/09/19_15:32:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.232 cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - lrmd[22683]: 2007/09/19_15:32:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:72:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=529, rc=0) complete cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=528, rc=0) complete cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=527, rc=0) complete cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=530, rc=0) complete cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 ERROR: cl_log: 467 messages were dropped cibmon[15210]: 2007/09/19_15:32:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.248 cibmon[15210]: 2007/09/19_15:32:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.249 cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 ERROR: cl_log: 321 messages were dropped cibmon[15210]: 2007/09/19_15:32:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.260 cibmon[15210]: 2007/09/19_15:32:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.261 cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.261 cibmon[15210]: 2007/09/19_15:32:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.262 cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=533, rc=254) Error cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=531, rc=0) complete cibmon[15210]: 2007/09/19_15:32:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=534, rc=7) complete cibmon[15210]: 2007/09/19_15:32:05 ERROR: cl_log: 60 messages were dropped crmd[15216]: 2007/09/19_15:32:19 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=532, rc=0) complete cibmon[15210]: 2007/09/19_15:32:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.264 cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.265 cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.265 cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.266 cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.266 cibmon[15210]: 2007/09/19_15:32:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.267 cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:32:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.276 cibmon[15210]: 2007/09/19_15:32:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.277 cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 ERROR: cl_log: 320 messages were dropped cibmon[15210]: 2007/09/19_15:32:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.288 cibmon[15210]: 2007/09/19_15:32:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.289 cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.296 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.297 cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.297 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.298 cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.298 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.299 cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - lrmd[22791]: 2007/09/19_15:32:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:73:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=535, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=537, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=536, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=538, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.299 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.300 cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.300 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.301 crmd[15216]: 2007/09/19_15:32:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=541, rc=254) Error cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=539, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=542, rc=7) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=540, rc=0) complete cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.301 cibmon[15210]: 2007/09/19_15:32:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.302 cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:32:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.308 cibmon[15210]: 2007/09/19_15:32:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.309 cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.309 cibmon[15210]: 2007/09/19_15:32:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.310 cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:32:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.312 cibmon[15210]: 2007/09/19_15:32:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.313 cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.313 cibmon[15210]: 2007/09/19_15:32:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.314 cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:32:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.320 cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.321 cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:32:24 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 690 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:32:24 info: G_SIG_dispatch: started at 430071903 should have started at 430071834 crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.321 crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.322 crmd[15216]: 2007/09/19_15:32:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:74:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=545, rc=0) complete cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=544, rc=0) complete cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:24 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=543, rc=0) complete cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:24 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=546, rc=0) complete cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.322 cibmon[15210]: 2007/09/19_15:32:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.323 cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 ERROR: cl_log: 146 messages were dropped lrmd[22885]: 2007/09/19_15:32:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:32:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.328 cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.329 cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=549, rc=254) Error cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.329 cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.330 cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.330 cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.331 cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.331 cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.332 crmd[15216]: 2007/09/19_15:32:25 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=547, rc=0) complete cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:25 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=550, rc=7) complete cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:25 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=548, rc=0) complete cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.332 cibmon[15210]: 2007/09/19_15:32:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.333 cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:32:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.336 cibmon[15210]: 2007/09/19_15:32:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.337 cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 ERROR: cl_log: 205 messages were dropped cibmon[15210]: 2007/09/19_15:32:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.344 cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.345 cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.345 cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.346 cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + lrmd[22993]: 2007/09/19_15:32:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.346 crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.347 crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:75:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=551, rc=0) complete cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=553, rc=0) complete cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=554, rc=0) complete cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=552, rc=0) complete cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:32:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.355 cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.356 cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:32:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.356 cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.357 cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.357 cibmon[15210]: 2007/09/19_15:32:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.358 cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=557, rc=254) Error cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=555, rc=0) complete cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=556, rc=0) complete cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=558, rc=7) complete cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.361 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.362 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.362 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.363 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.363 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.364 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.364 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.365 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - lrmd[23087]: 2007/09/19_15:32:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:76:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=562, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:29 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=560, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:29 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=561, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:29 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=559, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.365 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.366 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.366 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.367 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=565, rc=254) Error cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:30 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=563, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=564, rc=0) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=566, rc=7) complete cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.367 cibmon[15210]: 2007/09/19_15:32:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.368 cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.368 cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.369 cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.369 cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.370 cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.370 cibmon[15210]: 2007/09/19_15:32:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.371 cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - lrmd[23197]: 2007/09/19_15:32:32 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:77:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=569, rc=0) complete cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=568, rc=0) complete cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=567, rc=0) complete cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=570, rc=0) complete cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.376 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.377 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.377 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.378 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=571, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=573, rc=254) Error cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=572, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=574, rc=7) complete cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.378 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.379 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.379 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.380 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + lrmd[23302]: 2007/09/19_15:32:35 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:78:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=578, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=577, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=576, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:34 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=575, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.380 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.381 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.381 cibmon[15210]: 2007/09/19_15:32:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.382 cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=580, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=581, rc=254) Error cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:35 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=579, rc=0) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=582, rc=7) complete cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 ERROR: cl_log: 90 messages were dropped cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.385 cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.386 cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.386 lrmd[15213]: 2007/09/19_15:32:36 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.387 lrmd[23396]: 2007/09/19_15:32:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:79:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=585, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=584, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=583, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=586, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=589, rc=254) Error cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.387 cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.388 cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=587, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=590, rc=7) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=588, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.388 cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.389 cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.389 cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.390 cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.390 cibmon[15210]: 2007/09/19_15:32:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.391 cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - lrmd[23491]: 2007/09/19_15:32:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:80:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=592, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=593, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=591, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=594, rc=0) complete cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:32:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.391 cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.392 cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=597, rc=254) Error cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.392 cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.393 cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=595, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=596, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=598, rc=7) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.393 cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.394 cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.394 cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.395 cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - lrmd[23599]: 2007/09/19_15:32:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:81:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=601, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=599, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=600, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=602, rc=0) complete cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.395 cibmon[15210]: 2007/09/19_15:32:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.396 cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 ERROR: cl_log: 350 messages were dropped cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.408 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.409 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.409 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.410 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=603, rc=0) complete cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.410 crmd[15216]: 2007/09/19_15:32:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=605, rc=254) Error cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.411 crmd[15216]: 2007/09/19_15:32:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=604, rc=0) complete cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=606, rc=7) complete cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.411 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.412 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.412 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.413 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.413 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.414 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:82:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=609, rc=0) complete cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.414 cibmon[15210]: 2007/09/19_15:32:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.415 cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=608, rc=0) complete cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 ERROR: cl_log: 108 messages were dropped cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + lrmd[23693]: 2007/09/19_15:32:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=610, rc=0) complete cibmon[15210]: 2007/09/19_15:32:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=607, rc=0) complete cibmon[15210]: 2007/09/19_15:32:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.419 crmd[15216]: 2007/09/19_15:32:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=613, rc=254) Error cibmon[15210]: 2007/09/19_15:32:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.420 crmd[15216]: 2007/09/19_15:32:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=611, rc=0) complete cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=612, rc=0) complete cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=614, rc=7) complete cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 ERROR: cl_log: 12 messages were dropped cibmon[15210]: 2007/09/19_15:32:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.420 cibmon[15210]: 2007/09/19_15:32:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.421 cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:32:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.424 cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.425 cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.425 crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.426 crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:83:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:47 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=617, rc=0) complete cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:47 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=616, rc=0) complete cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:47 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=615, rc=0) complete cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:47 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=618, rc=0) complete cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.426 cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.427 cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + lrmd[23826]: 2007/09/19_15:32:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.427 cibmon[15210]: 2007/09/19_15:32:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.428 cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:32:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.432 cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.433 cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=621, rc=254) Error cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=619, rc=0) complete cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:48 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=622, rc=7) complete cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=620, rc=0) complete cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.433 cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.434 cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.434 cibmon[15210]: 2007/09/19_15:32:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.435 cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:34 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:32:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.441 cibmon[15210]: 2007/09/19_15:32:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.442 cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - lrmd[23924]: 2007/09/19_15:32:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=625, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=624, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=623, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=626, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:84:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=629, rc=254) Error cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=630, rc=7) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=627, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=628, rc=0) complete cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 ERROR: cl_log: 349 messages were dropped cibmon[15210]: 2007/09/19_15:32:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.454 cibmon[15210]: 2007/09/19_15:32:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.455 cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:32:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.455 cibmon[15210]: 2007/09/19_15:32:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.456 cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:85:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=631, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:32:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=632, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=633, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.457 crmd[15216]: 2007/09/19_15:32:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=634, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.458 crmd[15216]: 2007/09/19_15:32:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=635, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:32:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.458 cibmon[15210]: 2007/09/19_15:32:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.459 cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - lrmd[24067]: 2007/09/19_15:32:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=637, rc=254) Error cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=636, rc=0) complete cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=638, rc=7) complete cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:32:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.464 cibmon[15210]: 2007/09/19_15:32:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.465 cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:32:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.472 cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.473 cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:32:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.473 crmd[15216]: 2007/09/19_15:32:54 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.474 crmd[15216]: 2007/09/19_15:32:54 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:54 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:54 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:54 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:86:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=641, rc=0) complete cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=640, rc=0) complete cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.474 cibmon[15210]: 2007/09/19_15:32:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.475 cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: - lrmd[24160]: 2007/09/19_15:32:55 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=639, rc=0) complete cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:54 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=642, rc=0) complete cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 ERROR: cl_log: 262 messages were dropped cibmon[15210]: 2007/09/19_15:32:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.484 cibmon[15210]: 2007/09/19_15:32:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.485 cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.485 cibmon[15210]: 2007/09/19_15:32:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.486 cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:55 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=645, rc=254) Error cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=643, rc=0) complete cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=644, rc=0) complete cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:55 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=646, rc=7) complete cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:32:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.488 cibmon[15210]: 2007/09/19_15:32:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.489 cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.489 cibmon[15210]: 2007/09/19_15:32:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.490 cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:32:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.496 cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.497 cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.497 cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.498 cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - lrmd[24268]: 2007/09/19_15:32:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:87:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=648, rc=0) complete cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=649, rc=0) complete cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=650, rc=0) complete cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=647, rc=0) complete cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.498 cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.499 cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.499 cibmon[15210]: 2007/09/19_15:32:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.500 cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:32:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=651, rc=0) complete cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:32:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.504 cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.505 cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=653, rc=254) Error cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=654, rc=7) complete cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=652, rc=0) complete cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.505 cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.506 cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.506 cibmon[15210]: 2007/09/19_15:32:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.507 cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:32:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.512 cibmon[15210]: 2007/09/19_15:32:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.513 cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + lrmd[24364]: 2007/09/19_15:33:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:88:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=655, rc=0) complete cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=656, rc=0) complete cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=657, rc=0) complete cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:32:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=658, rc=0) complete cibmon[15210]: 2007/09/19_15:32:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.513 cibmon[15210]: 2007/09/19_15:32:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.514 cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=661, rc=254) Error cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 ERROR: cl_log: 175 messages were dropped crmd[15216]: 2007/09/19_15:33:00 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=659, rc=0) complete cibmon[15210]: 2007/09/19_15:32:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:00 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=660, rc=0) complete cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.520 crmd[15216]: 2007/09/19_15:33:00 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=662, rc=7) complete cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.521 cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.521 cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.522 cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.522 cibmon[15210]: 2007/09/19_15:32:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.523 cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + lrmd[24472]: 2007/09/19_15:33:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 ERROR: cl_log: 148 messages were dropped crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.528 crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.529 crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:89:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=666, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=665, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=664, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=663, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=669, rc=254) Error cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.529 cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.530 cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=667, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=670, rc=7) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=668, rc=0) complete cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.530 cibmon[15210]: 2007/09/19_15:32:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.531 cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:32:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.536 cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.537 cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.537 cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.538 cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - lrmd[24566]: 2007/09/19_15:33:05 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:90:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=672, rc=0) complete cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=673, rc=0) complete cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:04 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=671, rc=0) complete cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:04 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=674, rc=0) complete cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:05 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=677, rc=254) Error cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.538 cibmon[15210]: 2007/09/19_15:32:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.539 cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:32:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.545 cibmon[15210]: 2007/09/19_15:32:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.546 cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.546 cibmon[15210]: 2007/09/19_15:32:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.547 cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:33:05 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 90 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:33:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=675, rc=0) complete cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:05 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=676, rc=0) complete cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:05 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=678, rc=7) complete cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 ERROR: cl_log: 379 messages were dropped cibmon[15210]: 2007/09/19_15:32:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.560 cibmon[15210]: 2007/09/19_15:32:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.561 cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.561 cibmon[15210]: 2007/09/19_15:32:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.562 cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - lrmd[24689]: 2007/09/19_15:33:07 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:91:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=681, rc=0) complete cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=680, rc=0) complete cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:06 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=679, rc=0) complete cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:06 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=682, rc=0) complete cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=684, rc=0) complete cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:32:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.569 cibmon[15210]: 2007/09/19_15:32:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.570 cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:07 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=685, rc=254) Error cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:07 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=683, rc=0) complete cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=686, rc=7) complete cibmon[15210]: 2007/09/19_15:32:53 ERROR: cl_log: 2 messages were dropped crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.570 cibmon[15210]: 2007/09/19_15:32:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.571 cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.571 cibmon[15210]: 2007/09/19_15:32:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.572 cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + lrmd[24733]: 2007/09/19_15:33:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:92:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=689, rc=0) complete cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=693, rc=254) Error cibmon[15210]: 2007/09/19_15:32:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=688, rc=0) complete cibmon[15210]: 2007/09/19_15:32:55 ERROR: cl_log: 146 messages were dropped crmd[15216]: 2007/09/19_15:33:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=687, rc=0) complete cibmon[15210]: 2007/09/19_15:32:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=694, rc=7) complete cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.577 crmd[15216]: 2007/09/19_15:33:08 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=690, rc=0) complete cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.578 crmd[15216]: 2007/09/19_15:33:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=691, rc=0) complete cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.578 cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.579 crmd[15216]: 2007/09/19_15:33:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=692, rc=0) complete cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.579 cibmon[15210]: 2007/09/19_15:32:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.580 cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + lrmd[24864]: 2007/09/19_15:33:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:56 ERROR: cl_log: 118 messages were dropped crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:93:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.584 crmd[15216]: 2007/09/19_15:33:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=696, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.585 crmd[15216]: 2007/09/19_15:33:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=697, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=695, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=698, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=701, rc=254) Error cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.585 cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.586 cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=702, rc=7) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=699, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=700, rc=0) complete cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.586 cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.587 cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.587 cibmon[15210]: 2007/09/19_15:32:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.588 cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 ERROR: cl_log: 351 messages were dropped cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.600 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.601 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.601 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.602 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - lrmd[24974]: 2007/09/19_15:33:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:94:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=705, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=704, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=703, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:13 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=706, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=709, rc=254) Error cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.602 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.603 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.603 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.604 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.604 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.605 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=707, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=708, rc=0) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=710, rc=7) complete cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.605 cibmon[15210]: 2007/09/19_15:32:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.606 cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:32:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:00 ERROR: cl_log: 208 messages were dropped cibmon[15210]: 2007/09/19_15:33:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.613 cibmon[15210]: 2007/09/19_15:33:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.614 cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:95:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:01 ERROR: cl_log: 31 messages were dropped crmd[15216]: 2007/09/19_15:33:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=714, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=713, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.615 crmd[15216]: 2007/09/19_15:33:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=712, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.616 crmd[15216]: 2007/09/19_15:33:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=711, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=716, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.616 cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.617 cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - lrmd[25091]: 2007/09/19_15:33:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=717, rc=254) Error cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=715, rc=0) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=718, rc=7) complete cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.617 cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.618 cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.618 cibmon[15210]: 2007/09/19_15:33:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.619 cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:33:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.625 cibmon[15210]: 2007/09/19_15:33:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.626 cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 ERROR: cl_log: 174 messages were dropped crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.632 crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.633 crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:96:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=721, rc=0) complete cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.633 cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.634 cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - lrmd[25176]: 2007/09/19_15:33:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=720, rc=0) complete cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=719, rc=0) complete cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=722, rc=0) complete cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.634 cibmon[15210]: 2007/09/19_15:33:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.635 cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:33:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.640 cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.641 cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=725, rc=254) Error cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=723, rc=0) complete cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=726, rc=7) complete cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:19 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=724, rc=0) complete cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.641 cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.642 cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.642 cibmon[15210]: 2007/09/19_15:33:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.643 cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:33:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.648 cibmon[15210]: 2007/09/19_15:33:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.649 cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:33:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.649 cibmon[15210]: 2007/09/19_15:33:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.650 cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:33:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.658 cibmon[15210]: 2007/09/19_15:33:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.659 cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.659 cibmon[15210]: 2007/09/19_15:33:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.660 cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + lrmd[25297]: 2007/09/19_15:33:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:08 ERROR: cl_log: 175 messages were dropped crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.666 crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.667 crmd[15216]: 2007/09/19_15:33:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:97:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=728, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=727, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=729, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=730, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=732, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=733, rc=254) Error cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=731, rc=0) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=734, rc=7) complete cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 ERROR: cl_log: 378 messages were dropped cibmon[15210]: 2007/09/19_15:33:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.680 cibmon[15210]: 2007/09/19_15:33:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.681 cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.681 cibmon[15210]: 2007/09/19_15:33:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.682 cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:33:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.685 cibmon[15210]: 2007/09/19_15:33:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.686 cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - lrmd[25380]: 2007/09/19_15:33:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:98:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=735, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=737, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:24 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=736, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:24 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=738, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.686 cibmon[15210]: 2007/09/19_15:33:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.687 cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=741, rc=254) Error cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=739, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:25 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=740, rc=0) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:25 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=742, rc=7) complete cibmon[15210]: 2007/09/19_15:33:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:33:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.688 cibmon[15210]: 2007/09/19_15:33:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.689 cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:33:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.697 cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.698 cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.698 cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.699 cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:99:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=745, rc=0) complete cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=744, rc=0) complete cibmon[15210]: 2007/09/19_15:33:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=743, rc=0) complete cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.699 crmd[15216]: 2007/09/19_15:33:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=746, rc=0) complete cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.700 crmd[15216]: 2007/09/19_15:33:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=748, rc=0) complete cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.700 cibmon[15210]: 2007/09/19_15:33:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.701 cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 ERROR: cl_log: 90 messages were dropped cibmon[15210]: 2007/09/19_15:33:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.704 cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.705 cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - lrmd[25499]: 2007/09/19_15:33:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=749, rc=254) Error cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=747, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=750, rc=7) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.705 cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.706 cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + lrmd[25582]: 2007/09/19_15:33:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.706 crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.707 crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:100:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:29 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=753, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:29 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=752, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=754, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:29 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=751, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.707 cibmon[15210]: 2007/09/19_15:33:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.708 cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=757, rc=254) Error cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:30 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=755, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=758, rc=7) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=756, rc=0) complete cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.712 cibmon[15210]: 2007/09/19_15:33:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.713 cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:33:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.720 cibmon[15210]: 2007/09/19_15:33:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.721 cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - lrmd[25689]: 2007/09/19_15:33:32 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:101:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=761, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=760, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=762, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=759, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=765, rc=254) Error cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.721 cibmon[15210]: 2007/09/19_15:33:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.722 cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=764, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=763, rc=0) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=766, rc=7) complete cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:33:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.728 cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.729 cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.729 cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.730 cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.730 cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.731 cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - lrmd[25784]: 2007/09/19_15:33:35 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:102:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=769, rc=0) complete cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=768, rc=0) complete cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=767, rc=0) complete cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=770, rc=0) complete cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.731 cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.732 cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:33:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.732 cibmon[15210]: 2007/09/19_15:33:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.733 cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 ERROR: cl_log: 175 messages were dropped crmd[15216]: 2007/09/19_15:33:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=773, rc=254) Error cibmon[15210]: 2007/09/19_15:33:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:35 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=771, rc=0) complete cibmon[15210]: 2007/09/19_15:33:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.739 crmd[15216]: 2007/09/19_15:33:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=772, rc=0) complete cibmon[15210]: 2007/09/19_15:33:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.740 crmd[15216]: 2007/09/19_15:33:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=774, rc=7) complete cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:33:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.740 cibmon[15210]: 2007/09/19_15:33:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.741 cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.745 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.746 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + lrmd[25905]: 2007/09/19_15:33:38 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.746 crmd[15216]: 2007/09/19_15:33:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:103:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.747 crmd[15216]: 2007/09/19_15:33:37 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=777, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:37 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=776, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:37 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=778, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:37 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=775, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=780, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:38 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=781, rc=254) Error cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:38 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=779, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=782, rc=7) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.747 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.748 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.748 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.749 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:104:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:40 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=785, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.749 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.750 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + lrmd[25988]: 2007/09/19_15:33:41 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:40 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=784, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:40 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=786, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:40 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=783, rc=0) complete cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.750 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.751 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.751 cibmon[15210]: 2007/09/19_15:33:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.752 cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 ERROR: cl_log: 265 messages were dropped cibmon[15210]: 2007/09/19_15:33:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.761 cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.762 cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:41 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=787, rc=0) complete cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:41 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=789, rc=254) Error cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:41 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=788, rc=0) complete cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:41 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=790, rc=7) complete cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.762 cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.763 cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.763 cibmon[15210]: 2007/09/19_15:33:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.764 cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.768 cibmon[15210]: 2007/09/19_15:33:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.769 cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.769 cibmon[15210]: 2007/09/19_15:33:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.770 cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:33:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.776 cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.777 cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - lrmd[26094]: 2007/09/19_15:33:44 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:105:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=793, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:43 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=791, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=792, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=794, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.777 cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.778 cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:44 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=797, rc=254) Error cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:44 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=795, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=796, rc=0) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=798, rc=7) complete cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.778 cibmon[15210]: 2007/09/19_15:33:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.779 cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.783 cibmon[15210]: 2007/09/19_15:33:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.784 cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.784 cibmon[15210]: 2007/09/19_15:33:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.785 cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:33:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.793 cibmon[15210]: 2007/09/19_15:33:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.794 cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.794 cibmon[15210]: 2007/09/19_15:33:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.795 cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:29 ERROR: cl_log: 291 messages were dropped cibmon[15210]: 2007/09/19_15:33:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.805 cibmon[15210]: 2007/09/19_15:33:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.806 cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + lrmd[26188]: 2007/09/19_15:33:47 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:45 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:106:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=801, rc=0) complete cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=800, rc=0) complete cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=799, rc=0) complete cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=802, rc=0) complete cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:33:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.808 cibmon[15210]: 2007/09/19_15:33:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.809 cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=805, rc=254) Error cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.809 cibmon[15210]: 2007/09/19_15:33:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.810 cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=803, rc=0) complete cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=804, rc=0) complete cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=806, rc=7) complete cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:33:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.816 cibmon[15210]: 2007/09/19_15:33:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.817 cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 ERROR: cl_log: 204 messages were dropped cibmon[15210]: 2007/09/19_15:33:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.824 cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.825 cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 ERROR: cl_log: 2 messages were dropped crmd[15216]: 2007/09/19_15:33:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=807, rc=0) complete cibmon[15210]: 2007/09/19_15:33:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.825 cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.826 cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.826 cibmon[15210]: 2007/09/19_15:33:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.827 cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + lrmd[26297]: 2007/09/19_15:33:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:107:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=809, rc=0) complete cibmon[15210]: 2007/09/19_15:33:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=808, rc=0) complete cibmon[15210]: 2007/09/19_15:33:35 ERROR: cl_log: 291 messages were dropped crmd[15216]: 2007/09/19_15:33:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=811, rc=0) complete cibmon[15210]: 2007/09/19_15:33:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=810, rc=0) complete cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.837 cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.838 cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=813, rc=254) Error cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.838 cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.839 cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.839 cibmon[15210]: 2007/09/19_15:33:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.840 cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:33:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.840 cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.841 cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.841 cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.842 cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=812, rc=0) complete cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=814, rc=7) complete cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.842 cibmon[15210]: 2007/09/19_15:33:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.843 cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 ERROR: cl_log: 437 messages were dropped cibmon[15210]: 2007/09/19_15:33:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.858 cibmon[15210]: 2007/09/19_15:33:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.859 cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.859 cibmon[15210]: 2007/09/19_15:33:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.860 cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.864 cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.865 cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:108:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=816, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=817, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=815, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=818, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.865 cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.866 cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + lrmd[26390]: 2007/09/19_15:33:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=821, rc=254) Error cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=819, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=820, rc=0) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:33:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.871 cibmon[15210]: 2007/09/19_15:33:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.872 cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=822, rc=7) complete cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.872 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.873 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.873 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.874 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.874 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.875 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.875 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.876 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.876 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.877 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:109:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=825, rc=0) complete cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=824, rc=0) complete cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=823, rc=0) complete cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=826, rc=0) complete cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.877 cibmon[15210]: 2007/09/19_15:33:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.878 cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 ERROR: cl_log: 63 messages were dropped cibmon[15210]: 2007/09/19_15:33:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[26498]: 2007/09/19_15:33:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:33:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.880 cibmon[15210]: 2007/09/19_15:33:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.881 cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.881 cibmon[15210]: 2007/09/19_15:33:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.882 cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 ERROR: cl_log: 175 messages were dropped crmd[15216]: 2007/09/19_15:33:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=828, rc=0) complete cibmon[15210]: 2007/09/19_15:33:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=829, rc=254) Error cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.888 crmd[15216]: 2007/09/19_15:33:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=827, rc=0) complete cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.889 crmd[15216]: 2007/09/19_15:33:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=830, rc=7) complete cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.889 cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.890 cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.890 cibmon[15210]: 2007/09/19_15:33:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.891 cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.891 cibmon[15210]: 2007/09/19_15:33:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.892 cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.892 cibmon[15210]: 2007/09/19_15:33:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.893 cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + lrmd[26592]: 2007/09/19_15:33:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:47 ERROR: cl_log: 206 messages were dropped crmd[15216]: 2007/09/19_15:33:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:110:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=831, rc=0) complete cibmon[15210]: 2007/09/19_15:33:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.900 crmd[15216]: 2007/09/19_15:33:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=833, rc=0) complete cibmon[15210]: 2007/09/19_15:33:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.901 crmd[15216]: 2007/09/19_15:33:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=832, rc=0) complete cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=834, rc=0) complete cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=837, rc=254) Error cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.901 cibmon[15210]: 2007/09/19_15:33:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.902 cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.902 cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.903 cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=835, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=836, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=838, rc=7) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.903 cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.904 cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.904 cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.905 cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + lrmd[26702]: 2007/09/19_15:33:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 ERROR: cl_log: 90 messages were dropped crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.908 crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.909 crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:111:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=840, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=841, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=842, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=839, rc=0) complete cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:33:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.915 cibmon[15210]: 2007/09/19_15:33:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.916 cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.916 cibmon[15210]: 2007/09/19_15:33:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.917 cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.917 cibmon[15210]: 2007/09/19_15:33:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.918 cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=843, rc=0) complete cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=845, rc=254) Error cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=844, rc=0) complete cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:33:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=846, rc=7) complete cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.918 cibmon[15210]: 2007/09/19_15:33:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.919 cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.919 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.920 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.920 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.921 lrmd[26794]: 2007/09/19_15:34:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:112:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=848, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=849, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=847, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=850, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.921 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.922 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.922 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.923 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.923 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.924 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=853, rc=254) Error cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=851, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=852, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=854, rc=7) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.928 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.929 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.929 cibmon[15210]: 2007/09/19_15:33:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.930 cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:34:03 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - lrmd[26888]: 2007/09/19_15:34:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:113:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=857, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=856, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=855, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=858, rc=0) complete cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:33:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.934 cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.935 cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 ERROR: cl_log: 32 messages were dropped cibmon[15210]: 2007/09/19_15:33:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.936 cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.937 cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=861, rc=254) Error cibmon[15210]: 2007/09/19_15:33:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=859, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.937 crmd[15216]: 2007/09/19_15:34:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=860, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.938 crmd[15216]: 2007/09/19_15:34:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=862, rc=7) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.938 cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.939 cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + lrmd[26996]: 2007/09/19_15:34:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:114:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=865, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=864, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=863, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.939 crmd[15216]: 2007/09/19_15:34:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=866, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.940 crmd[15216]: 2007/09/19_15:34:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=869, rc=254) Error cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=867, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=870, rc=7) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=868, rc=0) complete cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:33:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.941 cibmon[15210]: 2007/09/19_15:33:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.942 cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.942 cibmon[15210]: 2007/09/19_15:33:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.943 cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 ERROR: cl_log: 32 messages were dropped cibmon[15210]: 2007/09/19_15:33:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.944 cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.945 cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - lrmd[27090]: 2007/09/19_15:34:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:115:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=873, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=872, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=871, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=874, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.945 cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.946 cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=877, rc=254) Error cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:33:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.952 cibmon[15210]: 2007/09/19_15:33:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.953 cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=875, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=876, rc=0) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=878, rc=7) complete cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.953 cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.954 cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.954 cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.955 cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.955 cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.956 cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - lrmd[27202]: 2007/09/19_15:34:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:116:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=881, rc=0) complete cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=879, rc=0) complete cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=880, rc=0) complete cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=882, rc=0) complete cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.956 cibmon[15210]: 2007/09/19_15:33:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.957 cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 ERROR: cl_log: 207 messages were dropped crmd[15216]: 2007/09/19_15:34:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=885, rc=254) Error cibmon[15210]: 2007/09/19_15:33:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=883, rc=0) complete cibmon[15210]: 2007/09/19_15:33:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.964 crmd[15216]: 2007/09/19_15:34:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=884, rc=0) complete cibmon[15210]: 2007/09/19_15:33:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.965 crmd[15216]: 2007/09/19_15:34:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=886, rc=7) complete cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.965 cibmon[15210]: 2007/09/19_15:33:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.966 cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + lrmd[27295]: 2007/09/19_15:34:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:57 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:58 ERROR: cl_log: 60 messages were dropped crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.968 crmd[15216]: 2007/09/19_15:34:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:117:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.969 crmd[15216]: 2007/09/19_15:34:12 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=890, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=889, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=888, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=887, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=893, rc=254) Error cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=891, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=892, rc=0) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.969 cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.970 cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=894, rc=7) complete cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.970 cibmon[15210]: 2007/09/19_15:33:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.971 cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:33:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 ERROR: cl_log: 381 messages were dropped cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.984 cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.985 cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.985 cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.986 cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.986 cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.987 cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[27403]: 2007/09/19_15:34:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.987 crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.988 crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:118:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=897, rc=0) complete cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=896, rc=0) complete cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=895, rc=0) complete cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=898, rc=0) complete cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.988 cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.989 cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=901, rc=254) Error cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.989 cibmon[15210]: 2007/09/19_15:34:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.990 cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 ERROR: cl_log: 295 messages were dropped cibmon[15210]: 2007/09/19_15:34:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1000 cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1001 cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=899, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=902, rc=7) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=900, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1001 cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1002 cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1002 cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1003 cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - lrmd[27497]: 2007/09/19_15:34:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:119:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=903, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=905, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=904, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=906, rc=0) complete cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1003 cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1004 cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1004 cibmon[15210]: 2007/09/19_15:34:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1005 cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:34:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1010 cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1011 cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=909, rc=254) Error cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=907, rc=0) complete cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=908, rc=0) complete cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=910, rc=7) complete cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1011 cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1012 cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1012 cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1013 cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 ERROR: cl_log: 91 messages were dropped cibmon[15210]: 2007/09/19_15:34:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1016 cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1017 cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:34:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1017 cibmon[15210]: 2007/09/19_15:34:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1018 cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 ERROR: cl_log: 379 messages were dropped cibmon[15210]: 2007/09/19_15:34:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1031 cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1032 cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - lrmd[27605]: 2007/09/19_15:34:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:120:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=913, rc=0) complete cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=912, rc=0) complete cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=911, rc=0) complete cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=914, rc=0) complete cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=917, rc=254) Error cibmon[15210]: 2007/09/19_15:34:07 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1032 cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1033 cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1033 cibmon[15210]: 2007/09/19_15:34:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1034 cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:34:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1040 cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1041 cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:21 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=915, rc=0) complete cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=916, rc=0) complete cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=918, rc=7) complete cibmon[15210]: 2007/09/19_15:34:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1041 cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1042 cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1042 cibmon[15210]: 2007/09/19_15:34:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1043 cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=921, rc=0) complete cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=920, rc=0) complete cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=919, rc=0) complete cibmon[15210]: 2007/09/19_15:34:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=922, rc=0) complete cibmon[15210]: 2007/09/19_15:34:10 ERROR: cl_log: 149 messages were dropped crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1048 cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1049 cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + lrmd[27698]: 2007/09/19_15:34:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:22 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:121:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1049 cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1050 cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=925, rc=254) Error cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=926, rc=7) complete cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=924, rc=0) complete cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=923, rc=0) complete cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1050 cibmon[15210]: 2007/09/19_15:34:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1051 cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 ERROR: cl_log: 351 messages were dropped cibmon[15210]: 2007/09/19_15:34:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1063 cibmon[15210]: 2007/09/19_15:34:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1064 cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:24 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1064 cibmon[15210]: 2007/09/19_15:34:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1065 cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1065 cibmon[15210]: 2007/09/19_15:34:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1066 cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 ERROR: cl_log: 294 messages were dropped cibmon[15210]: 2007/09/19_15:34:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1076 cibmon[15210]: 2007/09/19_15:34:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1077 cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:34:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1080 cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1081 crmd[15216]: 2007/09/19_15:34:24 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:24 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=927, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:24 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=928, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1081 cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1082 cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + lrmd[27821]: 2007/09/19_15:34:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:122:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1082 crmd[15216]: 2007/09/19_15:34:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=929, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1083 crmd[15216]: 2007/09/19_15:34:25 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=931, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:25 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=932, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=930, rc=0) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=933, rc=254) Error cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1083 cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1084 cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1084 cibmon[15210]: 2007/09/19_15:34:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1085 cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=934, rc=7) complete cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 ERROR: cl_log: 329 messages were dropped cibmon[15210]: 2007/09/19_15:34:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1096 cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1097 cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1097 cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1098 cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1098 cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1099 cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + lrmd[27875]: 2007/09/19_15:34:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=937, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=935, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=936, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:123:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=941, rc=254) Error cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=939, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=940, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1099 crmd[15216]: 2007/09/19_15:34:27 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=938, rc=0) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1100 crmd[15216]: 2007/09/19_15:34:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=942, rc=7) complete cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1100 cibmon[15210]: 2007/09/19_15:34:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1101 cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 ERROR: cl_log: 92 messages were dropped cibmon[15210]: 2007/09/19_15:34:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1104 cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1105 cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1105 cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1106 cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1106 cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1107 cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + lrmd[28022]: 2007/09/19_15:34:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1107 crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1108 crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:124:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=945, rc=0) complete cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=944, rc=0) complete cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=943, rc=0) complete cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=948, rc=0) complete cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=946, rc=0) complete cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:34:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1112 cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1113 cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=949, rc=254) Error cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=947, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=950, rc=7) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1113 cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1114 cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1114 cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1115 crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - lrmd[28103]: 2007/09/19_15:34:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:125:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=953, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=952, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:32 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=951, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=954, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1115 cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1116 cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:33 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=957, rc=254) Error cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:33 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=955, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:33 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=956, rc=0) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:33 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=958, rc=7) complete cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1116 cibmon[15210]: 2007/09/19_15:34:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1117 cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 ERROR: cl_log: 295 messages were dropped cibmon[15210]: 2007/09/19_15:34:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1127 cibmon[15210]: 2007/09/19_15:34:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1128 cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1128 cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1129 cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1129 cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1130 cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1130 cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1131 cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:34 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:126:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:35 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=959, rc=0) complete cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=960, rc=0) complete cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=961, rc=0) complete cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=962, rc=0) complete cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=964, rc=0) complete cibmon[15210]: 2007/09/19_15:34:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1131 cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1132 cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:34:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1133 cibmon[15210]: 2007/09/19_15:34:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1134 cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:34:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1137 cibmon[15210]: 2007/09/19_15:34:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1138 cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - lrmd[28224]: 2007/09/19_15:34:35 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=965, rc=254) Error cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=963, rc=0) complete cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=966, rc=7) complete cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1138 cibmon[15210]: 2007/09/19_15:34:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1139 cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:34:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1140 cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1141 cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + lrmd[28305]: 2007/09/19_15:34:38 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1141 crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1142 crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:127:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=967, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=969, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=968, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:37 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=970, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:38 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=973, rc=254) Error cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1142 cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1143 cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:38 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=971, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=974, rc=7) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:38 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=972, rc=0) complete cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1143 cibmon[15210]: 2007/09/19_15:34:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1144 cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 ERROR: cl_log: 149 messages were dropped cibmon[15210]: 2007/09/19_15:34:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1149 cibmon[15210]: 2007/09/19_15:34:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1150 cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1150 cibmon[15210]: 2007/09/19_15:34:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1151 cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 ERROR: cl_log: 207 messages were dropped cibmon[15210]: 2007/09/19_15:34:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1158 cibmon[15210]: 2007/09/19_15:34:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1159 cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - lrmd[28399]: 2007/09/19_15:34:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:128:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=976, rc=0) complete cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:40 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=975, rc=0) complete cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:40 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=977, rc=0) complete cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:40 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=978, rc=0) complete cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1159 cibmon[15210]: 2007/09/19_15:34:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1160 cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1160 cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1161 cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 ERROR: cl_log: 92 messages were dropped cibmon[15210]: 2007/09/19_15:34:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1164 cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1165 cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=979, rc=0) complete cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=981, rc=254) Error cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=980, rc=0) complete cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=982, rc=7) complete cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1165 cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1166 cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1166 cibmon[15210]: 2007/09/19_15:34:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1167 cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + lrmd[28478]: 2007/09/19_15:34:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=983, rc=0) complete cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=984, rc=0) complete cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:129:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=985, rc=0) complete cibmon[15210]: 2007/09/19_15:34:29 ERROR: cl_log: 236 messages were dropped crmd[15216]: 2007/09/19_15:34:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=989, rc=254) Error cibmon[15210]: 2007/09/19_15:34:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=987, rc=0) complete cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1175 crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=990, rc=7) complete cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1176 crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=988, rc=0) complete cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=986, rc=0) complete cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1176 cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1177 cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1177 cibmon[15210]: 2007/09/19_15:34:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1178 cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:34:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1179 cibmon[15210]: 2007/09/19_15:34:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1180 cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1180 cibmon[15210]: 2007/09/19_15:34:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1181 cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - lrmd[28601]: 2007/09/19_15:34:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:130:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=993, rc=0) complete cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=992, rc=0) complete cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=991, rc=0) complete cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=994, rc=0) complete cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 ERROR: cl_log: 207 messages were dropped cibmon[15210]: 2007/09/19_15:34:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1188 cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1189 cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1189 cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1190 cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1190 cibmon[15210]: 2007/09/19_15:34:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1191 cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=997, rc=254) Error cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=995, rc=0) complete cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=996, rc=0) complete cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=998, rc=7) complete cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 ERROR: cl_log: 497 messages were dropped cibmon[15210]: 2007/09/19_15:34:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1208 cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1209 cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1209 cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1210 cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1210 cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1211 cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1001, rc=0) complete cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1000, rc=0) complete cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=999, rc=0) complete cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1211 cibmon[15210]: 2007/09/19_15:34:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1212 cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + lrmd[28680]: 2007/09/19_15:34:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:131:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:46 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1005, rc=254) Error cibmon[15210]: 2007/09/19_15:34:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1003, rc=0) complete cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1212 crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1004, rc=0) complete cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1213 crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1002, rc=0) complete cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:46 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1006, rc=7) complete cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1213 cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1214 cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1214 cibmon[15210]: 2007/09/19_15:34:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1215 cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 ERROR: cl_log: 35 messages were dropped cibmon[15210]: 2007/09/19_15:34:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1216 cibmon[15210]: 2007/09/19_15:34:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1217 cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:132:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1008, rc=0) complete cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:48 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1009, rc=0) complete cibmon[15210]: 2007/09/19_15:34:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1217 cibmon[15210]: 2007/09/19_15:34:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1218 cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:34:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1224 cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1225 cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - lrmd[28832]: 2007/09/19_15:34:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1007, rc=0) complete cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1010, rc=0) complete cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1225 cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1226 cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1226 cibmon[15210]: 2007/09/19_15:34:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1227 cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 ERROR: cl_log: 149 messages were dropped cibmon[15210]: 2007/09/19_15:34:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1232 cibmon[15210]: 2007/09/19_15:34:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1233 cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1233 cibmon[15210]: 2007/09/19_15:34:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1234 cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1013, rc=254) Error cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:49 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1011, rc=0) complete cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1014, rc=7) complete cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1012, rc=0) complete cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:34:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1240 cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1241 cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1241 cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1242 cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1242 cibmon[15210]: 2007/09/19_15:34:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1243 cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1248 cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1249 cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1249 crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1250 crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:133:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:50 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1015, rc=0) complete cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1250 cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1251 cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + lrmd[28939]: 2007/09/19_15:34:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:50 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1017, rc=0) complete cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1016, rc=0) complete cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:50 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1018, rc=0) complete cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1251 cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1252 cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1256 crmd[15216]: 2007/09/19_15:34:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1021, rc=254) Error cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1257 cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1019, rc=0) complete cibmon[15210]: 2007/09/19_15:34:41 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1257 cibmon[15210]: 2007/09/19_15:34:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1258 cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 ERROR: cl_log: 350 messages were dropped cibmon[15210]: 2007/09/19_15:34:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1270 cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1271 cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1020, rc=0) complete cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:51 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1022, rc=7) complete cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1271 cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1272 cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1272 cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1273 cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1273 cibmon[15210]: 2007/09/19_15:34:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1274 cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:34:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1280 cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1281 cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1281 cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1282 cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - lrmd[29073]: 2007/09/19_15:34:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:134:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1025, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1024, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1023, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1026, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1282 cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1283 cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1283 cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1284 cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1027, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 ERROR: cl_log: 35 messages were dropped cibmon[15210]: 2007/09/19_15:34:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1285 crmd[15216]: 2007/09/19_15:34:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1029, rc=254) Error cibmon[15210]: 2007/09/19_15:34:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1286 crmd[15216]: 2007/09/19_15:34:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1028, rc=0) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1030, rc=7) complete cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:34:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1287 cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1288 cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:34:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1292 cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1293 cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1293 cibmon[15210]: 2007/09/19_15:34:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1294 cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 ERROR: cl_log: 264 messages were dropped cibmon[15210]: 2007/09/19_15:34:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1303 cibmon[15210]: 2007/09/19_15:34:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1304 cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1304 cibmon[15210]: 2007/09/19_15:34:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1305 cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1305 cibmon[15210]: 2007/09/19_15:34:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1306 cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1306 cibmon[15210]: 2007/09/19_15:34:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1307 cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:49 ERROR: cl_log: 150 messages were dropped crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1312 crmd[15216]: 2007/09/19_15:34:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:135:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1313 crmd[15216]: 2007/09/19_15:34:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1032, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1031, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1033, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1034, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1313 cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1314 cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - lrmd[29191]: 2007/09/19_15:34:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1036, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1037, rc=254) Error cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1314 cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1315 cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1315 cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1316 cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1035, rc=0) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1038, rc=7) complete cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1316 cibmon[15210]: 2007/09/19_15:34:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1317 cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 ERROR: cl_log: 93 messages were dropped cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1320 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1321 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1321 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1322 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1322 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1323 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1323 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1324 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1324 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1325 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:136:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1041, rc=0) complete cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:34:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1040, rc=0) complete cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 ERROR: cl_log: 34 messages were dropped cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1326 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1327 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + lrmd[29272]: 2007/09/19_15:34:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:34:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1042, rc=0) complete cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1039, rc=0) complete cibmon[15210]: 2007/09/19_15:34:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1327 cibmon[15210]: 2007/09/19_15:34:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1328 cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:34:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1332 cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1333 cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1333 cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1334 cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:34:59 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 50 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:34:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1045, rc=254) Error cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1043, rc=0) complete cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1044, rc=0) complete cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:34:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1046, rc=7) complete cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1334 cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1335 cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1335 cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1336 cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 ERROR: cl_log: 5 messages were dropped cibmon[15210]: 2007/09/19_15:34:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1336 cibmon[15210]: 2007/09/19_15:34:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1337 cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1337 cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1338 cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1338 cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1339 cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - lrmd[29366]: 2007/09/19_15:35:01 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:137:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1048, rc=0) complete cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1049, rc=0) complete cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1047, rc=0) complete cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1050, rc=0) complete cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1339 cibmon[15210]: 2007/09/19_15:34:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1340 cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:01 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1053, rc=254) Error cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 ERROR: cl_log: 322 messages were dropped cibmon[15210]: 2007/09/19_15:34:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1351 cibmon[15210]: 2007/09/19_15:34:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1352 cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1352 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1353 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1353 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1354 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:01 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1051, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1054, rc=7) complete cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1052, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1354 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1355 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1355 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1356 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1356 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1357 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1357 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1358 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1358 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1359 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1359 cibmon[15210]: 2007/09/19_15:34:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1360 cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:138:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1056, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1057, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1055, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1058, rc=0) complete cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1360 cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1361 cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1361 cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1362 cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - lrmd[29474]: 2007/09/19_15:35:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1362 cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1363 cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1363 cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1364 cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1364 cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1365 cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1059, rc=0) complete cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1365 crmd[15216]: 2007/09/19_15:35:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1061, rc=254) Error cibmon[15210]: 2007/09/19_15:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1366 crmd[15216]: 2007/09/19_15:35:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1060, rc=0) complete cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1062, rc=7) complete cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 ERROR: cl_log: 102 messages were dropped cibmon[15210]: 2007/09/19_15:34:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1369 cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1370 cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1370 cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1371 cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1371 cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1372 cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - lrmd[29568]: 2007/09/19_15:35:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:139:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1065, rc=0) complete cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1064, rc=0) complete cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1063, rc=0) complete cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1066, rc=0) complete cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1372 cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1373 cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1373 cibmon[15210]: 2007/09/19_15:34:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1374 cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1069, rc=254) Error cibmon[15210]: 2007/09/19_15:34:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1067, rc=0) complete cibmon[15210]: 2007/09/19_15:34:59 ERROR: cl_log: 65 messages were dropped crmd[15216]: 2007/09/19_15:35:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1068, rc=0) complete cibmon[15210]: 2007/09/19_15:34:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1070, rc=7) complete cibmon[15210]: 2007/09/19_15:34:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1376 cibmon[15210]: 2007/09/19_15:34:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1377 cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:34:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1377 cibmon[15210]: 2007/09/19_15:34:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1378 cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:34:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 ERROR: cl_log: 61 messages were dropped cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1380 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1381 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1381 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1382 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1382 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1383 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:35:08 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 850 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:35:08 info: G_SIG_dispatch: started at 430088223 should have started at 430088138 crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + lrmd[29676]: 2007/09/19_15:35:09 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 ERROR: cl_log: 33 messages were dropped crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1384 crmd[15216]: 2007/09/19_15:35:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:140:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1385 crmd[15216]: 2007/09/19_15:35:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1073, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1071, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1072, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:08 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1074, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1385 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1386 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1386 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1387 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:09 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1077, rc=254) Error cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:09 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1078, rc=7) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1075, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1076, rc=0) complete cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1387 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1388 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1388 cibmon[15210]: 2007/09/19_15:35:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1389 cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:00 info: log_data_element: cib_apply_diff: + lrmd[29770]: 2007/09/19_15:35:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 ERROR: cl_log: 88 messages were dropped crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1392 crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1393 crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:141:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1081, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1082, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1080, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1079, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1393 cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1394 cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1085, rc=254) Error cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1083, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1086, rc=7) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1084, rc=0) complete cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1394 cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1395 cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1395 cibmon[15210]: 2007/09/19_15:35:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1396 cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 ERROR: cl_log: 92 messages were dropped cibmon[15210]: 2007/09/19_15:35:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1399 cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1400 cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - lrmd[29862]: 2007/09/19_15:35:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:142:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1087, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1089, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1088, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1092, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1400 cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1401 cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1093, rc=254) Error cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1091, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1094, rc=7) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:14 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1090, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1401 cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1402 cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1402 cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1403 cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + lrmd[29972]: 2007/09/19_15:35:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:143:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1096, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1095, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1097, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1098, rc=0) complete cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1403 cibmon[15210]: 2007/09/19_15:35:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1404 cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1101, rc=254) Error cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1404 crmd[15216]: 2007/09/19_15:35:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1099, rc=0) complete cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1405 crmd[15216]: 2007/09/19_15:35:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1102, rc=7) complete cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1100, rc=0) complete cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1405 cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1406 cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1406 cibmon[15210]: 2007/09/19_15:35:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1407 cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 ERROR: cl_log: 37 messages were dropped cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[30093]: 2007/09/19_15:35:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1408 crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1409 crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:144:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1105, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1104, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1106, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1103, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1108, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1409 cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1410 cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1410 cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1411 cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1109, rc=254) Error cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1107, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1110, rc=7) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1411 cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1412 cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 ERROR: cl_log: 151 messages were dropped cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1417 cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1418 cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1418 cibmon[15210]: 2007/09/19_15:35:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1419 cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - lrmd[30174]: 2007/09/19_15:35:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:20 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:145:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:20 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1113, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1112, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1111, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1114, rc=0) complete cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1117, rc=254) Error cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:35:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1424 cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1425 cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1425 cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1426 cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:21 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1115, rc=0) complete cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1116, rc=0) complete cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1118, rc=7) complete cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1426 cibmon[15210]: 2007/09/19_15:35:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1427 cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:35:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1432 cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1433 cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1433 cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1434 cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1434 cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1435 cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:146:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1121, rc=0) complete cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1119, rc=0) complete cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1435 cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1436 cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1436 cibmon[15210]: 2007/09/19_15:35:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1437 cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - lrmd[30295]: 2007/09/19_15:35:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1120, rc=0) complete cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1122, rc=0) complete cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:23 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1124, rc=0) complete cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 ERROR: cl_log: 151 messages were dropped cibmon[15210]: 2007/09/19_15:35:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1442 cibmon[15210]: 2007/09/19_15:35:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1443 cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1443 cibmon[15210]: 2007/09/19_15:35:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1444 cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:35:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1448 cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1449 cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1449 cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1450 cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1125, rc=254) Error cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1123, rc=0) complete cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1126, rc=7) complete cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1450 cibmon[15210]: 2007/09/19_15:35:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1451 cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:35:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1456 cibmon[15210]: 2007/09/19_15:35:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1457 cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1457 cibmon[15210]: 2007/09/19_15:35:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1458 cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:35:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1464 cibmon[15210]: 2007/09/19_15:35:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1465 cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1465 cibmon[15210]: 2007/09/19_15:35:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1466 cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + lrmd[30376]: 2007/09/19_15:35:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:13 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:14 ERROR: cl_log: 263 messages were dropped crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1475 crmd[15216]: 2007/09/19_15:35:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:147:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1476 crmd[15216]: 2007/09/19_15:35:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1127, rc=0) complete cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1129, rc=0) complete cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1128, rc=0) complete cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1130, rc=0) complete cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1476 cibmon[15210]: 2007/09/19_15:35:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1477 cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:35:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1480 cibmon[15210]: 2007/09/19_15:35:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1481 cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1481 cibmon[15210]: 2007/09/19_15:35:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1482 cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 ERROR: cl_log: 206 messages were dropped cibmon[15210]: 2007/09/19_15:35:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1489 cibmon[15210]: 2007/09/19_15:35:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1490 cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1131, rc=0) complete cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1133, rc=254) Error cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1132, rc=0) complete cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1134, rc=7) complete cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:35:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1496 cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1497 cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1497 cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1498 cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1498 cibmon[15210]: 2007/09/19_15:35:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1499 cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 ERROR: cl_log: 206 messages were dropped cibmon[15210]: 2007/09/19_15:35:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1506 cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1507 cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:148:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1137, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1136, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1142, rc=7) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1135, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1138, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1140, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1507 cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1508 cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + lrmd[30513]: 2007/09/19_15:35:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1141, rc=254) Error cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1139, rc=0) complete cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1508 cibmon[15210]: 2007/09/19_15:35:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1509 cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:35:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1513 cibmon[15210]: 2007/09/19_15:35:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1514 cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1514 cibmon[15210]: 2007/09/19_15:35:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1515 cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:35:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1520 cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1521 cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1145, rc=0) complete cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1144, rc=0) complete cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1147, rc=0) complete cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1143, rc=0) complete cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1146, rc=0) complete cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1521 cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1522 cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - lrmd[30578]: 2007/09/19_15:35:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1522 cibmon[15210]: 2007/09/19_15:35:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1523 cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 ERROR: cl_log: 150 messages were dropped cibmon[15210]: 2007/09/19_15:35:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1528 cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1529 cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:149:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1529 cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1530 cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1149, rc=254) Error cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1150, rc=7) complete cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:31 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1148, rc=0) complete cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1530 cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1531 cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1531 cibmon[15210]: 2007/09/19_15:35:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1532 crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:35:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1536 cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1537 cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:35:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1539 cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1540 cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:150:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1153, rc=0) complete cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1152, rc=0) complete cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1151, rc=0) complete cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:33 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1154, rc=0) complete cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1156, rc=0) complete cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1540 cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1541 cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1541 cibmon[15210]: 2007/09/19_15:35:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1542 cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1542 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1543 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + lrmd[30699]: 2007/09/19_15:35:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:34 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1157, rc=254) Error cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1155, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:34 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1158, rc=7) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1544 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1545 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1545 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1546 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1546 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1547 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - lrmd[30736]: 2007/09/19_15:35:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:151:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1161, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1165, rc=254) Error cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1160, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1159, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1166, rc=7) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1162, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1163, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1547 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1548 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1164, rc=0) complete cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1548 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1549 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1549 cibmon[15210]: 2007/09/19_15:35:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1550 cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + lrmd[30874]: 2007/09/19_15:35:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 ERROR: cl_log: 64 messages were dropped crmd[15216]: 2007/09/19_15:35:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:152:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1169, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1552 crmd[15216]: 2007/09/19_15:35:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1168, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1553 crmd[15216]: 2007/09/19_15:35:38 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1167, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:38 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1170, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1553 cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1554 cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:39 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1171, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1173, rc=254) Error cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1172, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:39 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1174, rc=7) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1554 cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1555 cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1555 cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1556 lrmd[15213]: 2007/09/19_15:35:40 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - lrmd[30997]: 2007/09/19_15:35:41 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:153:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1177, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1176, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1175, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1180, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:40 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1178, rc=0) complete cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1556 cibmon[15210]: 2007/09/19_15:35:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1557 cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 ERROR: cl_log: 93 messages were dropped cibmon[15210]: 2007/09/19_15:35:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1560 cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1561 cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1561 cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1562 crmd[15216]: 2007/09/19_15:35:41 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1179, rc=0) complete cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:41 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1181, rc=254) Error cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:41 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1182, rc=7) complete cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1562 cibmon[15210]: 2007/09/19_15:35:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1563 cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:35:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1568 cibmon[15210]: 2007/09/19_15:35:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1569 cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:154:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:43 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1185, rc=0) complete cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1184, rc=0) complete cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:43 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1183, rc=0) complete cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1569 cibmon[15210]: 2007/09/19_15:35:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1570 cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:35:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[31078]: 2007/09/19_15:35:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1186, rc=0) complete cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1573 cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1574 cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:44 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1189, rc=254) Error cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1574 cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1575 cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 ERROR: cl_log: 13 messages were dropped cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1576 cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1577 cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:35:44 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 130 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:35:44 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1187, rc=0) complete cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1190, rc=7) complete cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1188, rc=0) complete cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1577 cibmon[15210]: 2007/09/19_15:35:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1578 cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 ERROR: cl_log: 108 messages were dropped cibmon[15210]: 2007/09/19_15:35:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1581 cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1582 cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:35:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1582 cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1583 cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1583 cibmon[15210]: 2007/09/19_15:35:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1584 cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 ERROR: cl_log: 292 messages were dropped cibmon[15210]: 2007/09/19_15:35:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1594 cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1595 cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + lrmd[31186]: 2007/09/19_15:35:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:155:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1193, rc=0) complete cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1192, rc=0) complete cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1191, rc=0) complete cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:45 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1194, rc=0) complete cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1595 cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1596 cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1596 cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1597 cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1597 cibmon[15210]: 2007/09/19_15:35:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1598 cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:35:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1600 cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1601 cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1601 cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1602 cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:46 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1197, rc=254) Error cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:46 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1195, rc=0) complete cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:46 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1196, rc=0) complete cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:46 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1198, rc=7) complete cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1602 cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1603 cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1603 cibmon[15210]: 2007/09/19_15:35:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1604 cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:35:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1610 cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1611 cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - lrmd[31280]: 2007/09/19_15:35:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:156:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1199, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1200, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1201, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1202, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:35:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1611 cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1612 cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:49 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1203, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1612 cibmon[15210]: 2007/09/19_15:35:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1613 crmd[15216]: 2007/09/19_15:35:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1204, rc=0) complete cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1205, rc=254) Error cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 ERROR: cl_log: 206 messages were dropped cibmon[15210]: 2007/09/19_15:35:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1620 cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1621 cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1206, rc=7) complete cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1621 cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1622 cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1622 cibmon[15210]: 2007/09/19_15:35:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1623 cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 ERROR: cl_log: 266 messages were dropped cibmon[15210]: 2007/09/19_15:35:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1632 cibmon[15210]: 2007/09/19_15:35:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1633 cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 ERROR: cl_log: 203 messages were dropped cibmon[15210]: 2007/09/19_15:35:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1640 cibmon[15210]: 2007/09/19_15:35:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1641 cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:157:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1209, rc=0) complete cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1207, rc=0) complete cibmon[15210]: 2007/09/19_15:35:40 ERROR: cl_log: 3 messages were dropped crmd[15216]: 2007/09/19_15:35:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1208, rc=0) complete cibmon[15210]: 2007/09/19_15:35:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1210, rc=0) complete cibmon[15210]: 2007/09/19_15:35:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1641 cibmon[15210]: 2007/09/19_15:35:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1642 cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:35:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1648 cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1649 cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - lrmd[31388]: 2007/09/19_15:35:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1649 cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1650 cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1650 cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1651 crmd[15216]: 2007/09/19_15:35:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1213, rc=254) Error cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1211, rc=0) complete cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1212, rc=0) complete cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1214, rc=7) complete cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1651 cibmon[15210]: 2007/09/19_15:35:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1652 cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 ERROR: cl_log: 150 messages were dropped cibmon[15210]: 2007/09/19_15:35:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1657 cibmon[15210]: 2007/09/19_15:35:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1658 cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1658 crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1659 crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:158:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1217, rc=0) complete cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1216, rc=0) complete cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1215, rc=0) complete cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1218, rc=0) complete cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:35:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1664 cibmon[15210]: 2007/09/19_15:35:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1665 cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: - lrmd[31482]: 2007/09/19_15:35:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1221, rc=254) Error cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:35:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1666 cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1667 cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:35:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1669 cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1670 cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1670 cibmon[15210]: 2007/09/19_15:35:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1671 cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1219, rc=0) complete cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1222, rc=7) complete cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1220, rc=0) complete cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:35:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1672 cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1673 cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1673 cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1674 cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1674 cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1675 cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1675 cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1676 cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:35:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1677 cibmon[15210]: 2007/09/19_15:35:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1678 cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:35:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1683 cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1684 cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1684 cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1685 cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1685 cibmon[15210]: 2007/09/19_15:35:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1686 cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1686 cibmon[15210]: 2007/09/19_15:35:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1687 cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 ERROR: cl_log: 33 messages were dropped cibmon[15210]: 2007/09/19_15:35:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1688 cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1689 cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:35:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1690 cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1691 cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - lrmd[31590]: 2007/09/19_15:35:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:159:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1224, rc=0) complete cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1225, rc=0) complete cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1223, rc=0) complete cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:35:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1226, rc=0) complete cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1691 cibmon[15210]: 2007/09/19_15:35:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1692 cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1229, rc=254) Error cibmon[15210]: 2007/09/19_15:35:48 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1227, rc=0) complete cibmon[15210]: 2007/09/19_15:35:49 ERROR: cl_log: 148 messages were dropped crmd[15216]: 2007/09/19_15:35:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1230, rc=7) complete cibmon[15210]: 2007/09/19_15:35:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1228, rc=0) complete cibmon[15210]: 2007/09/19_15:35:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1697 cibmon[15210]: 2007/09/19_15:35:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1698 cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1698 cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1699 cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1699 cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1700 cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1700 cibmon[15210]: 2007/09/19_15:35:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1701 cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 ERROR: cl_log: 91 messages were dropped cibmon[15210]: 2007/09/19_15:35:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1704 cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1705 cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1705 cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1706 cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:160:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1233, rc=0) complete cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1231, rc=0) complete cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:35:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1232, rc=0) complete cibmon[15210]: 2007/09/19_15:35:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:35:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1234, rc=0) complete cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1706 cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1707 cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1707 cibmon[15210]: 2007/09/19_15:35:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1708 cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 ERROR: cl_log: 150 messages were dropped cibmon[15210]: 2007/09/19_15:35:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1713 cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1714 cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - lrmd[31684]: 2007/09/19_15:36:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:35:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1717 cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1718 cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:35:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1718 cibmon[15210]: 2007/09/19_15:35:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1719 cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1237, rc=254) Error cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:00 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1235, rc=0) complete cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:00 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1238, rc=7) complete cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:00 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1236, rc=0) complete cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:35:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1720 cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1721 cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1721 cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1722 cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1722 cibmon[15210]: 2007/09/19_15:35:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1723 cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:35:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1727 cibmon[15210]: 2007/09/19_15:35:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1728 cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + lrmd[31794]: 2007/09/19_15:36:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1728 crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1729 crmd[15216]: 2007/09/19_15:36:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:161:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1241, rc=0) complete cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1239, rc=0) complete cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1240, rc=0) complete cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1242, rc=0) complete cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 ERROR: cl_log: 61 messages were dropped cibmon[15210]: 2007/09/19_15:35:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1731 cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1732 cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1732 cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1733 cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1245, rc=254) Error cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1243, rc=0) complete cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1244, rc=0) complete cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1246, rc=7) complete cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1733 cibmon[15210]: 2007/09/19_15:35:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1734 cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1736 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1737 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1737 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1738 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - lrmd[31886]: 2007/09/19_15:36:05 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:04 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:162:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:04 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1248, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:04 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1249, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:04 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1247, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:04 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1250, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1738 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1739 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1739 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1740 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:05 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1253, rc=254) Error cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1251, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:05 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1252, rc=0) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:05 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1254, rc=7) complete cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1740 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1741 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1741 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1742 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1742 cibmon[15210]: 2007/09/19_15:35:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1743 cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1743 cibmon[15210]: 2007/09/19_15:35:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1744 cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1744 cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1745 cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1745 cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1746 cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1746 cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1747 cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - lrmd[31994]: 2007/09/19_15:36:07 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:163:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1257, rc=0) complete cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1256, rc=0) complete cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:06 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1255, rc=0) complete cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1258, rc=0) complete cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:07 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1261, rc=254) Error cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1747 cibmon[15210]: 2007/09/19_15:35:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1748 cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 ERROR: cl_log: 129 messages were dropped cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1752 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1753 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1753 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1754 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1754 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1755 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:07 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1259, rc=0) complete cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1262, rc=7) complete cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1260, rc=0) complete cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1755 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1756 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1756 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1757 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1757 cibmon[15210]: 2007/09/19_15:35:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1758 cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:35:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 ERROR: cl_log: 64 messages were dropped cibmon[15210]: 2007/09/19_15:36:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1760 cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1761 cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1761 cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1762 cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 ERROR: cl_log: 32 messages were dropped cibmon[15210]: 2007/09/19_15:36:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1763 cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1764 cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:36:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1764 cibmon[15210]: 2007/09/19_15:36:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1765 cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:164:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1264, rc=0) complete cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1265, rc=0) complete cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1263, rc=0) complete cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:09 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1266, rc=0) complete cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:36:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1768 cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1769 cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + lrmd[32088]: 2007/09/19_15:36:10 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1769 cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1770 cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1770 cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1771 cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1771 cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1772 cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1772 cibmon[15210]: 2007/09/19_15:36:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1773 cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:10 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1267, rc=0) complete cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:10 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1269, rc=254) Error cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:10 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1270, rc=7) complete cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:10 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1268, rc=0) complete cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 ERROR: cl_log: 122 messages were dropped cibmon[15210]: 2007/09/19_15:36:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1777 cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1778 cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1778 cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1779 cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1779 cibmon[15210]: 2007/09/19_15:36:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1780 cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:36:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1784 cibmon[15210]: 2007/09/19_15:36:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1785 cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1785 cibmon[15210]: 2007/09/19_15:36:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1786 cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - lrmd[32196]: 2007/09/19_15:36:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:165:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:12 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1274, rc=0) complete cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1273, rc=0) complete cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1272, rc=0) complete cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1271, rc=0) complete cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:36:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1792 cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1793 cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1793 cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1794 cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1277, rc=254) Error cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1275, rc=0) complete cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:13 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1278, rc=7) complete cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1276, rc=0) complete cibmon[15210]: 2007/09/19_15:36:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1794 cibmon[15210]: 2007/09/19_15:36:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1795 cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1800 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1801 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1801 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1802 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1802 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1803 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + lrmd[32290]: 2007/09/19_15:36:15 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:166:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1280, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:14 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1281, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:14 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1279, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1803 crmd[15216]: 2007/09/19_15:36:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1282, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1804 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1804 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1805 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1805 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1806 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:15 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1285, rc=254) Error cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:15 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1283, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1284, rc=0) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1286, rc=7) complete cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1806 cibmon[15210]: 2007/09/19_15:36:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1807 cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 ERROR: cl_log: 38 messages were dropped cibmon[15210]: 2007/09/19_15:36:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1808 cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1809 cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1809 cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1810 cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - lrmd[32400]: 2007/09/19_15:36:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:167:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1289, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1287, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1288, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1290, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1810 cibmon[15210]: 2007/09/19_15:36:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1811 cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1293, rc=254) Error cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1291, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1294, rc=7) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1292, rc=0) complete cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 ERROR: cl_log: 149 messages were dropped cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1816 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1817 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1817 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1818 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1818 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1819 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - lrmd[32521]: 2007/09/19_15:36:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:168:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1297, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1296, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:20 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1295, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1298, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1300, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1301, rc=254) Error cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:21 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1299, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1302, rc=7) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1819 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1820 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1820 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1821 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1821 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1822 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + lrmd[32602]: 2007/09/19_15:36:23 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:169:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1304, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1305, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:22 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1303, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1306, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1822 crmd[15216]: 2007/09/19_15:36:23 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1309, rc=254) Error cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1823 crmd[15216]: 2007/09/19_15:36:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1307, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:23 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1310, rc=7) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1308, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 ERROR: cl_log: 37 messages were dropped cibmon[15210]: 2007/09/19_15:36:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1824 cibmon[15210]: 2007/09/19_15:36:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1825 cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - lrmd[32705]: 2007/09/19_15:36:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:170:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1313, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1312, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1311, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1314, rc=0) complete cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1825 cibmon[15210]: 2007/09/19_15:36:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1826 cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1317, rc=254) Error cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1316, rc=0) complete cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:36:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1828 cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1829 cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:36:26 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 50 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:36:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1315, rc=0) complete cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1318, rc=7) complete cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1829 cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1830 cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1830 cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1831 cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1831 cibmon[15210]: 2007/09/19_15:36:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1832 cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 ERROR: cl_log: 5 messages were dropped cibmon[15210]: 2007/09/19_15:36:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1832 cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1833 cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - lrmd[336]: 2007/09/19_15:36:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:171:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1321, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1320, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1319, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1322, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1833 cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1834 cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1325, rc=254) Error cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1323, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:29 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1326, rc=7) complete cibmon[15210]: 2007/09/19_15:36:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1324, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1834 cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1835 cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1835 cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1836 cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cib[15212]: 2007/09/19_15:36:32 info: cib_stats: Processed 4023 operations (176.00us average, 0% utilization) in the last 10min lrmd[461]: 2007/09/19_15:36:32 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:172:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1836 crmd[15216]: 2007/09/19_15:36:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1329, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1837 crmd[15216]: 2007/09/19_15:36:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1328, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1327, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1330, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:31 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1332, rc=0) complete cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 ERROR: cl_log: 323 messages were dropped cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1848 cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1849 cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1331, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1333, rc=254) Error cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1334, rc=7) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1337, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1336, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1335, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1338, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:34 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:173:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1849 cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1850 cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + lrmd[559]: 2007/09/19_15:36:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:34 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1342, rc=7) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:34 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1341, rc=254) Error cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1339, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1340, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1850 cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1851 cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1851 cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1852 cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - lrmd[664]: 2007/09/19_15:36:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:174:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1345, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1344, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1343, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1346, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1348, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1349, rc=254) Error cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1347, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1350, rc=7) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1852 cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1853 cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + lrmd[745]: 2007/09/19_15:36:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:175:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1353, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1352, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1853 crmd[15216]: 2007/09/19_15:36:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1351, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1854 crmd[15216]: 2007/09/19_15:36:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1354, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:40 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1357, rc=254) Error cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1355, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1356, rc=0) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1358, rc=7) complete cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 ERROR: cl_log: 64 messages were dropped cibmon[15210]: 2007/09/19_15:36:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1856 cibmon[15210]: 2007/09/19_15:36:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1857 cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1857 cibmon[15210]: 2007/09/19_15:36:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1858 cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:176:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1360, rc=0) complete cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1361, rc=0) complete cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1359, rc=0) complete cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:41 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1362, rc=0) complete cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 ERROR: cl_log: 58 messages were dropped cibmon[15210]: 2007/09/19_15:36:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1860 cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1861 cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + lrmd[866]: 2007/09/19_15:36:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:42 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1364, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1365, rc=254) Error cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1363, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1366, rc=7) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1861 cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1862 cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1862 cibmon[15210]: 2007/09/19_15:36:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1863 cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - lrmd[947]: 2007/09/19_15:36:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:177:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1369, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1367, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1368, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1370, rc=0) complete cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1373, rc=254) Error cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:17 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 ERROR: cl_log: 265 messages were dropped cibmon[15210]: 2007/09/19_15:36:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1872 cibmon[15210]: 2007/09/19_15:36:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1873 cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1371, rc=0) complete cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1374, rc=7) complete cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1372, rc=0) complete cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1873 cibmon[15210]: 2007/09/19_15:36:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1874 cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:36:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1880 cibmon[15210]: 2007/09/19_15:36:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1881 cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:178:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1377, rc=0) complete cibmon[15210]: 2007/09/19_15:36:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1881 crmd[15216]: 2007/09/19_15:36:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1376, rc=0) complete cibmon[15210]: 2007/09/19_15:36:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1882 crmd[15216]: 2007/09/19_15:36:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1375, rc=0) complete cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1378, rc=0) complete cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1380, rc=0) complete cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 ERROR: cl_log: 408 messages were dropped cibmon[15210]: 2007/09/19_15:36:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1896 cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1897 cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - lrmd[1084]: 2007/09/19_15:36:47 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1381, rc=254) Error cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1379, rc=0) complete cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1382, rc=7) complete cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1897 cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1898 cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1898 cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1899 cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1899 cibmon[15210]: 2007/09/19_15:36:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1900 cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 ERROR: cl_log: 352 messages were dropped cibmon[15210]: 2007/09/19_15:36:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1912 cibmon[15210]: 2007/09/19_15:36:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1913 cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 ERROR: cl_log: 292 messages were dropped cibmon[15210]: 2007/09/19_15:36:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1923 cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1924 cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1924 cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1925 cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1925 cibmon[15210]: 2007/09/19_15:36:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1926 cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + lrmd[1180]: 2007/09/19_15:36:50 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:27 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:28 ERROR: cl_log: 62 messages were dropped crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:179:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1928 crmd[15216]: 2007/09/19_15:36:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1385, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1929 crmd[15216]: 2007/09/19_15:36:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1383, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1384, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1386, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1929 cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1930 cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:50 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1389, rc=254) Error cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1387, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1388, rc=0) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1390, rc=7) complete cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1930 cibmon[15210]: 2007/09/19_15:36:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1931 cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 ERROR: cl_log: 264 messages were dropped cibmon[15210]: 2007/09/19_15:36:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1940 cibmon[15210]: 2007/09/19_15:36:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1941 cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1941 cibmon[15210]: 2007/09/19_15:36:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1942 cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 ERROR: cl_log: 90 messages were dropped cibmon[15210]: 2007/09/19_15:36:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1945 cibmon[15210]: 2007/09/19_15:36:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1946 cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1946 cibmon[15210]: 2007/09/19_15:36:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1947 cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - lrmd[1303]: 2007/09/19_15:36:53 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:180:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1392, rc=0) complete cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1393, rc=0) complete cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1391, rc=0) complete cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1396, rc=0) complete cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 ERROR: cl_log: 380 messages were dropped cibmon[15210]: 2007/09/19_15:36:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1960 cibmon[15210]: 2007/09/19_15:36:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1961 cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + lrmd[1430]: 2007/09/19_15:36:55 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:53 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1397, rc=254) Error cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:53 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1395, rc=0) complete cibmon[15210]: 2007/09/19_15:36:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1398, rc=7) complete cibmon[15210]: 2007/09/19_15:36:34 ERROR: cl_log: 205 messages were dropped crmd[15216]: 2007/09/19_15:36:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1394, rc=0) complete cibmon[15210]: 2007/09/19_15:36:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1968 crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1969 crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1401, rc=0) complete cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1400, rc=0) complete cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1399, rc=0) complete cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:54 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1402, rc=0) complete cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:181:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:55 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1406, rc=7) complete cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1969 cibmon[15210]: 2007/09/19_15:36:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1970 cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 ERROR: cl_log: 236 messages were dropped cibmon[15210]: 2007/09/19_15:36:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1978 cibmon[15210]: 2007/09/19_15:36:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1979 cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:55 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1405, rc=254) Error cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1403, rc=0) complete cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1404, rc=0) complete cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 ERROR: cl_log: 494 messages were dropped cibmon[15210]: 2007/09/19_15:36:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1996 cibmon[15210]: 2007/09/19_15:36:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1997 cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1997 crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.1998 crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:182:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1409, rc=0) complete cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1407, rc=0) complete cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1408, rc=0) complete cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:57 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1410, rc=0) complete cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1412, rc=0) complete cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 ERROR: cl_log: 293 messages were dropped cibmon[15210]: 2007/09/19_15:36:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2008 cibmon[15210]: 2007/09/19_15:36:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2009 cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2009 cibmon[15210]: 2007/09/19_15:36:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2010 cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:36:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2016 cibmon[15210]: 2007/09/19_15:36:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2017 cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - lrmd[1535]: 2007/09/19_15:36:58 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:58 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1413, rc=254) Error cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1411, rc=0) complete cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:58 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1414, rc=7) complete cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2017 cibmon[15210]: 2007/09/19_15:36:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2018 cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:36:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2024 cibmon[15210]: 2007/09/19_15:36:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2025 cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 ERROR: cl_log: 205 messages were dropped cibmon[15210]: 2007/09/19_15:36:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2032 cibmon[15210]: 2007/09/19_15:36:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2033 cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2033 cibmon[15210]: 2007/09/19_15:36:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2034 cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:36:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2040 cibmon[15210]: 2007/09/19_15:36:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2041 cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - lrmd[1618]: 2007/09/19_15:37:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:183:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1417, rc=0) complete cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1416, rc=0) complete cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1415, rc=0) complete cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:36:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1418, rc=0) complete cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2041 cibmon[15210]: 2007/09/19_15:36:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2042 cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1421, rc=254) Error cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:36:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2048 cibmon[15210]: 2007/09/19_15:36:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2049 cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:00 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1419, rc=0) complete cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:00 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1422, rc=7) complete cibmon[15210]: 2007/09/19_15:36:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:00 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1420, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 ERROR: cl_log: 263 messages were dropped cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2058 cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2059 cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2059 cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2060 cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + lrmd[1718]: 2007/09/19_15:37:03 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:184:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1424, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1425, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2060 crmd[15216]: 2007/09/19_15:37:02 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1423, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2061 crmd[15216]: 2007/09/19_15:37:02 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1426, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2061 cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2062 cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:03 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1428, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:03 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1429, rc=254) Error cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:03 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1427, rc=0) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:03 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1430, rc=7) complete cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2062 cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2063 cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2063 cibmon[15210]: 2007/09/19_15:36:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2064 cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2064 cibmon[15210]: 2007/09/19_15:36:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2065 cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + lrmd[1822]: 2007/09/19_15:37:05 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:185:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1433, rc=0) complete cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1432, rc=0) complete cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1431, rc=0) complete cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:04 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1434, rc=0) complete cibmon[15210]: 2007/09/19_15:36:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2065 cibmon[15210]: 2007/09/19_15:36:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2066 cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 ERROR: cl_log: 96 messages were dropped cibmon[15210]: 2007/09/19_15:36:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2069 cibmon[15210]: 2007/09/19_15:36:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2070 cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:05 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1437, rc=254) Error cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1435, rc=0) complete cibmon[15210]: 2007/09/19_15:36:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2070 cibmon[15210]: 2007/09/19_15:36:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2071 cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:05 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1436, rc=0) complete cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:05 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1438, rc=7) complete cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 ERROR: cl_log: 32 messages were dropped cibmon[15210]: 2007/09/19_15:36:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2072 cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2073 cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2073 cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2074 cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 ERROR: cl_log: 90 messages were dropped cibmon[15210]: 2007/09/19_15:36:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2077 cibmon[15210]: 2007/09/19_15:36:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2078 cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:52 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:36:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2078 cibmon[15210]: 2007/09/19_15:36:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2079 cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - lrmd[1914]: 2007/09/19_15:37:07 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:186:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1439, rc=0) complete cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1441, rc=0) complete cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1440, rc=0) complete cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:06 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1442, rc=0) complete cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 ERROR: cl_log: 235 messages were dropped cibmon[15210]: 2007/09/19_15:36:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2087 cibmon[15210]: 2007/09/19_15:36:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2088 cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:07 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1445, rc=254) Error cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:07 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1443, rc=0) complete cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2088 cibmon[15210]: 2007/09/19_15:36:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2089 cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1446, rc=7) complete cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1444, rc=0) complete cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 ERROR: cl_log: 235 messages were dropped cibmon[15210]: 2007/09/19_15:36:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2097 cibmon[15210]: 2007/09/19_15:36:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2098 cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2098 cibmon[15210]: 2007/09/19_15:36:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2099 cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + lrmd[2023]: 2007/09/19_15:37:09 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:56 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:57 ERROR: cl_log: 177 messages were dropped crmd[15216]: 2007/09/19_15:37:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:187:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1449, rc=0) complete cibmon[15210]: 2007/09/19_15:36:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2105 crmd[15216]: 2007/09/19_15:37:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1447, rc=0) complete cibmon[15210]: 2007/09/19_15:36:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2106 crmd[15216]: 2007/09/19_15:37:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1448, rc=0) complete cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:09 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1450, rc=0) complete cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:09 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1453, rc=254) Error cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2106 cibmon[15210]: 2007/09/19_15:36:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2107 cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:36:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2112 cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2113 cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1451, rc=0) complete cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:10 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1454, rc=7) complete cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:10 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1452, rc=0) complete cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2113 cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2114 cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2114 cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2115 cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2115 cibmon[15210]: 2007/09/19_15:36:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2116 cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:36:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[2118]: 2007/09/19_15:37:12 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2120 crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2121 crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:188:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1456, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1457, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1459, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1455, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:11 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1458, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2121 cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2122 cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:12 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1461, rc=254) Error cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:12 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1460, rc=0) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1462, rc=7) complete cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2122 cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2123 cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2123 cibmon[15210]: 2007/09/19_15:36:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2124 cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:36:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:37:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2128 cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2129 cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - lrmd[2238]: 2007/09/19_15:37:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:189:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1465, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:13 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1464, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1463, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1468, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:13 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1466, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2129 cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2130 cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1469, rc=254) Error cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1467, rc=0) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1470, rc=7) complete cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2130 cibmon[15210]: 2007/09/19_15:37:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2131 cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 ERROR: cl_log: 150 messages were dropped cibmon[15210]: 2007/09/19_15:37:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2136 cibmon[15210]: 2007/09/19_15:37:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2137 cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2137 cibmon[15210]: 2007/09/19_15:37:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2138 cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + lrmd[2319]: 2007/09/19_15:37:17 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:190:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1472, rc=0) complete cibmon[15210]: 2007/09/19_15:37:02 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:16 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1473, rc=0) complete cibmon[15210]: 2007/09/19_15:37:03 ERROR: cl_log: 177 messages were dropped crmd[15216]: 2007/09/19_15:37:16 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1471, rc=0) complete cibmon[15210]: 2007/09/19_15:37:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:16 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1474, rc=0) complete cibmon[15210]: 2007/09/19_15:37:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2144 crmd[15216]: 2007/09/19_15:37:17 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1477, rc=254) Error cibmon[15210]: 2007/09/19_15:37:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2145 cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:37:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2148 cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2149 cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2149 cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2150 cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:17 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1475, rc=0) complete cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:17 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1476, rc=0) complete cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:17 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1478, rc=7) complete cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2150 cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2151 cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2151 cibmon[15210]: 2007/09/19_15:37:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2152 cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:04 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 ERROR: cl_log: 234 messages were dropped cibmon[15210]: 2007/09/19_15:37:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2160 cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2161 cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[2409]: 2007/09/19_15:37:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2161 crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2162 crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:191:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1481, rc=0) complete cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1480, rc=0) complete cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1479, rc=0) complete cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:19 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1484, rc=0) complete cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2162 cibmon[15210]: 2007/09/19_15:37:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2163 cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:37:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2169 cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2170 cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2170 cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2171 cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1485, rc=254) Error cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1483, rc=0) complete cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:20 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1486, rc=7) complete cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1482, rc=0) complete cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2171 cibmon[15210]: 2007/09/19_15:37:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2172 cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:37:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2176 cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2177 cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2177 cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2178 cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2178 cibmon[15210]: 2007/09/19_15:37:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2179 cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - lrmd[2524]: 2007/09/19_15:37:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:192:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1489, rc=0) complete cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1488, rc=0) complete cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1487, rc=0) complete cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1490, rc=0) complete cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 ERROR: cl_log: 149 messages were dropped cibmon[15210]: 2007/09/19_15:37:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2184 cibmon[15210]: 2007/09/19_15:37:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2185 cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1493, rc=254) Error cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1491, rc=0) complete cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1492, rc=0) complete cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1494, rc=7) complete cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2185 cibmon[15210]: 2007/09/19_15:37:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2186 cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 ERROR: cl_log: 293 messages were dropped cibmon[15210]: 2007/09/19_15:37:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2196 cibmon[15210]: 2007/09/19_15:37:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2197 cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1497, rc=0) complete cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1496, rc=0) complete cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1495, rc=0) complete cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2197 cibmon[15210]: 2007/09/19_15:37:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2198 cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:37:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2200 cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2201 cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - lrmd[2622]: 2007/09/19_15:37:23 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:193:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1498, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:23 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1501, rc=254) Error cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1499, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:23 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1500, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1502, rc=7) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2201 cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2202 cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2202 lrmd[2728]: 2007/09/19_15:37:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2203 crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:194:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1505, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1504, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1503, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1506, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2203 cibmon[15210]: 2007/09/19_15:37:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2204 cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1509, rc=254) Error cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1507, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1510, rc=7) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1508, rc=0) complete cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 ERROR: cl_log: 382 messages were dropped cibmon[15210]: 2007/09/19_15:37:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2217 cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2218 cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2218 cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2219 cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2219 cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2220 cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2220 cibmon[15210]: 2007/09/19_15:37:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2221 cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:13 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 ERROR: cl_log: 92 messages were dropped cibmon[15210]: 2007/09/19_15:37:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2224 cibmon[15210]: 2007/09/19_15:37:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2225 cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2225 cibmon[15210]: 2007/09/19_15:37:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2226 cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:195:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1513, rc=0) complete cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1512, rc=0) complete cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1511, rc=0) complete cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1514, rc=0) complete cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1516, rc=0) complete cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 ERROR: cl_log: 208 messages were dropped cibmon[15210]: 2007/09/19_15:37:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2234 cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + lrmd[2855]: 2007/09/19_15:37:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2234 cibmon[15210]: 2007/09/19_15:37:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2235 cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:37:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2235 cibmon[15210]: 2007/09/19_15:37:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2236 cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1517, rc=254) Error cibmon[15210]: 2007/09/19_15:37:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1515, rc=0) complete cibmon[15210]: 2007/09/19_15:37:18 ERROR: cl_log: 234 messages were dropped crmd[15216]: 2007/09/19_15:37:29 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1518, rc=7) complete cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2244 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2245 cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2245 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2246 cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2252 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2253 cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2253 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2254 cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:196:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1521, rc=0) complete cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1520, rc=0) complete cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2254 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2255 cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2255 cibmon[15210]: 2007/09/19_15:37:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2256 crmd[15216]: 2007/09/19_15:37:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1522, rc=0) complete cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - lrmd[2941]: 2007/09/19_15:37:32 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1519, rc=0) complete cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 ERROR: cl_log: 5 messages were dropped cibmon[15210]: 2007/09/19_15:37:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2256 cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2257 cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2257 cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2258 cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2258 cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2259 cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1525, rc=254) Error cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1523, rc=0) complete cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1526, rc=7) complete cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1524, rc=0) complete cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2259 cibmon[15210]: 2007/09/19_15:37:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2260 cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:37:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2264 cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2265 cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2265 crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2266 crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:197:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1530, rc=0) complete cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1529, rc=0) complete cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1528, rc=0) complete cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2266 cibmon[15210]: 2007/09/19_15:37:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2267 cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: - lrmd[3056]: 2007/09/19_15:37:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1527, rc=0) complete cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:37:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2272 cibmon[15210]: 2007/09/19_15:37:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2273 cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2273 cibmon[15210]: 2007/09/19_15:37:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2274 cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:37:34 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 170 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:37:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1531, rc=0) complete cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:37:34 info: G_SIG_dispatch: started at 430102880 should have started at 430102863 crmd[15216]: 2007/09/19_15:37:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1532, rc=0) complete cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:34 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1533, rc=254) Error cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:34 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1534, rc=7) complete cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:22 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:37:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2280 cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2281 cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2281 cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2282 cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:37:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2285 cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2286 cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 ERROR: cl_log: 18 messages were dropped cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2287 cibmon[15210]: 2007/09/19_15:37:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2288 cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 ERROR: cl_log: 131 messages were dropped cibmon[15210]: 2007/09/19_15:37:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2292 cibmon[15210]: 2007/09/19_15:37:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2293 cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 ERROR: cl_log: 437 messages were dropped cibmon[15210]: 2007/09/19_15:37:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2308 cibmon[15210]: 2007/09/19_15:37:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2309 cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2309 cibmon[15210]: 2007/09/19_15:37:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2310 cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - lrmd[3151]: 2007/09/19_15:37:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:198:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1537, rc=0) complete cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1536, rc=0) complete cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1535, rc=0) complete cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1538, rc=0) complete cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:37:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1541, rc=254) Error cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2312 cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2313 cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2313 cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2314 cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1539, rc=0) complete cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1542, rc=7) complete cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1540, rc=0) complete cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2314 cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2315 cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2315 cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2316 cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2316 cibmon[15210]: 2007/09/19_15:37:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2317 cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:37:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2321 cibmon[15210]: 2007/09/19_15:37:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2322 cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2322 cibmon[15210]: 2007/09/19_15:37:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2323 cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:29 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 ERROR: cl_log: 148 messages were dropped cibmon[15210]: 2007/09/19_15:37:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2328 cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2329 cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2329 cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2330 cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2330 cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2331 cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2331 cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2332 cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:199:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1545, rc=0) complete cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1543, rc=0) complete cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1544, rc=0) complete cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1548, rc=0) complete cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1546, rc=0) complete cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2332 cibmon[15210]: 2007/09/19_15:37:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2333 cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2333 cibmon[15210]: 2007/09/19_15:37:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2334 lrmd[3272]: 2007/09/19_15:37:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 ERROR: cl_log: 66 messages were dropped cibmon[15210]: 2007/09/19_15:37:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2336 cibmon[15210]: 2007/09/19_15:37:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2337 crmd[15216]: 2007/09/19_15:37:40 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1549, rc=254) Error cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:37:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2338 cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2339 cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1547, rc=0) complete cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1550, rc=7) complete cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2339 cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2340 cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2340 cibmon[15210]: 2007/09/19_15:37:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2341 cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 ERROR: cl_log: 91 messages were dropped cibmon[15210]: 2007/09/19_15:37:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[3353]: 2007/09/19_15:37:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2344 crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2345 crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:200:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1553, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1551, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1552, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1554, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2345 cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2346 cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2346 cibmon[15210]: 2007/09/19_15:37:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2347 cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1557, rc=254) Error cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1555, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1558, rc=7) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1556, rc=0) complete cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 ERROR: cl_log: 207 messages were dropped cibmon[15210]: 2007/09/19_15:37:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2354 cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2355 cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2355 cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2356 cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2356 cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2357 cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2357 cibmon[15210]: 2007/09/19_15:37:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2358 cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 ERROR: cl_log: 61 messages were dropped cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2360 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2361 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - lrmd[3474]: 2007/09/19_15:37:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:201:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1559, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1561, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1560, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1562, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1564, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1565, rc=254) Error cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2361 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2362 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2362 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2363 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1563, rc=0) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1566, rc=7) complete cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2363 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2364 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2364 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2365 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2365 cibmon[15210]: 2007/09/19_15:37:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2366 cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 ERROR: cl_log: 181 messages were dropped cibmon[15210]: 2007/09/19_15:37:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2372 cibmon[15210]: 2007/09/19_15:37:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2373 cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 ERROR: cl_log: 29 messages were dropped cibmon[15210]: 2007/09/19_15:37:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2374 cibmon[15210]: 2007/09/19_15:37:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2375 cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:37 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:38 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2375 cibmon[15210]: 2007/09/19_15:37:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2376 cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + lrmd[3574]: 2007/09/19_15:37:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:202:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1569, rc=0) complete cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1568, rc=0) complete cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1567, rc=0) complete cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1574, rc=7) complete cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1570, rc=0) complete cibmon[15210]: 2007/09/19_15:37:38 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:37:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2376 cibmon[15210]: 2007/09/19_15:37:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2377 cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2377 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2378 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1573, rc=254) Error cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1571, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1572, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2378 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2379 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2379 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2380 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2380 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2381 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2381 crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2382 crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:203:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1576, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1577, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1575, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2382 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2383 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - lrmd[3685]: 2007/09/19_15:37:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:50 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1578, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1580, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1581, rc=254) Error cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1579, rc=0) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2383 cibmon[15210]: 2007/09/19_15:37:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2384 cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:51 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1582, rc=7) complete cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2384 cibmon[15210]: 2007/09/19_15:37:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2385 cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:40 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2385 cibmon[15210]: 2007/09/19_15:37:40 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2386 cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:40 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 ERROR: cl_log: 68 messages were dropped cibmon[15210]: 2007/09/19_15:37:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2388 cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2389 cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - lrmd[3771]: 2007/09/19_15:37:53 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:204:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1585, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1584, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1583, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:52 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1586, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:53 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1589, rc=254) Error cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2389 cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2390 cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:37:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2394 cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2395 cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:37:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2395 cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2396 cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:53 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1587, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1588, rc=0) complete cibmon[15210]: 2007/09/19_15:37:41 ERROR: cl_log: 2 messages were dropped crmd[15216]: 2007/09/19_15:37:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1590, rc=7) complete cibmon[15210]: 2007/09/19_15:37:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2396 cibmon[15210]: 2007/09/19_15:37:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2397 cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:37:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2402 cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2403 cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2403 cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2404 cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2404 cibmon[15210]: 2007/09/19_15:37:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2405 cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:44 ERROR: cl_log: 90 messages were dropped crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:205:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2408 crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1593, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2409 crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1592, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1591, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1595, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1594, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2409 cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2410 cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - lrmd[3895]: 2007/09/19_15:37:56 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1596, rc=0) complete cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2410 cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2411 cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:56 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1597, rc=254) Error cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2411 cibmon[15210]: 2007/09/19_15:37:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2412 cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:44 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 ERROR: cl_log: 121 messages were dropped cibmon[15210]: 2007/09/19_15:37:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2416 cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2417 cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:56 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1598, rc=7) complete cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2417 cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2418 cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2418 cibmon[15210]: 2007/09/19_15:37:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2419 cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2425 cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2426 cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2426 cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2427 cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2427 crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2428 crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:206:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1599, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:37:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1601, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2428 cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2429 cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + lrmd[3975]: 2007/09/19_15:37:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:37:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1600, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1602, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2429 cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2430 cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2430 cibmon[15210]: 2007/09/19_15:37:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2431 cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1605, rc=254) Error cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1603, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1604, rc=0) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:37:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1606, rc=7) complete cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:47 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:49 ERROR: cl_log: 93 messages were dropped cibmon[15210]: 2007/09/19_15:37:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2434 cibmon[15210]: 2007/09/19_15:37:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2435 cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 ERROR: cl_log: 176 messages were dropped cibmon[15210]: 2007/09/19_15:37:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2441 cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2442 cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2442 cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2443 cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2443 cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2444 cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2444 cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2445 cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:38:00 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 110 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - lrmd[15213]: 2007/09/19_15:38:00 info: G_SIG_dispatch: started at 430105498 should have started at 430105487 crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:207:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:00 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1608, rc=0) complete cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:00 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1609, rc=0) complete cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:00 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1607, rc=0) complete cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1610, rc=0) complete cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1612, rc=0) complete cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 ERROR: cl_log: 92 messages were dropped cibmon[15210]: 2007/09/19_15:37:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2448 cibmon[15210]: 2007/09/19_15:37:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2449 cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:50 info: log_data_element: cib_apply_diff: + lrmd[4096]: 2007/09/19_15:38:01 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:37:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2449 cibmon[15210]: 2007/09/19_15:37:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2450 cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2450 cibmon[15210]: 2007/09/19_15:37:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2451 cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:37:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2457 cibmon[15210]: 2007/09/19_15:37:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2458 cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:01 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1613, rc=254) Error cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:01 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1611, rc=0) complete cibmon[15210]: 2007/09/19_15:37:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1614, rc=7) complete cibmon[15210]: 2007/09/19_15:37:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2458 cibmon[15210]: 2007/09/19_15:37:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2459 cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:52 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 ERROR: cl_log: 351 messages were dropped cibmon[15210]: 2007/09/19_15:37:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2471 cibmon[15210]: 2007/09/19_15:37:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2472 cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:54 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2472 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2473 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2473 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2474 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2474 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2475 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + lrmd[4177]: 2007/09/19_15:38:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:208:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1616, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1617, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1615, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1618, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2475 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2476 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2476 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2477 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2477 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2478 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2478 crmd[15216]: 2007/09/19_15:38:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1621, rc=254) Error cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2479 crmd[15216]: 2007/09/19_15:38:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1619, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1620, rc=0) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1622, rc=7) complete cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 ERROR: cl_log: 9 messages were dropped cibmon[15210]: 2007/09/19_15:37:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2479 cibmon[15210]: 2007/09/19_15:37:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2480 cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:37:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2484 cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2485 cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2485 cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2486 cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[4269]: 2007/09/19_15:38:07 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2486 crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2487 crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:209:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1625, rc=0) complete cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1624, rc=0) complete cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1623, rc=0) complete cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1628, rc=0) complete cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 ERROR: cl_log: 91 messages were dropped cibmon[15210]: 2007/09/19_15:37:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2490 cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2491 cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2491 cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2492 cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:07 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1629, rc=254) Error cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:07 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1627, rc=0) complete cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1630, rc=7) complete cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1626, rc=0) complete cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2492 cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2493 cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2493 cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2494 cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2494 cibmon[15210]: 2007/09/19_15:37:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2495 cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 ERROR: cl_log: 35 messages were dropped cibmon[15210]: 2007/09/19_15:37:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2496 cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2497 cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1633, rc=0) complete cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1632, rc=0) complete cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1631, rc=0) complete cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1634, rc=0) complete cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:210:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2497 cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2498 cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + lrmd[4397]: 2007/09/19_15:38:09 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1638, rc=7) complete cibmon[15210]: 2007/09/19_15:37:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2498 cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2499 cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2499 cibmon[15210]: 2007/09/19_15:37:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2500 cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:37:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 ERROR: cl_log: 150 messages were dropped crmd[15216]: 2007/09/19_15:38:09 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1637, rc=254) Error cibmon[15210]: 2007/09/19_15:38:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1635, rc=0) complete cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2505 crmd[15216]: 2007/09/19_15:38:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1636, rc=0) complete cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2506 crmd[15216]: 2007/09/19_15:38:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2506 cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2507 cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1640, rc=0) complete cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1639, rc=0) complete cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2507 cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2508 cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2508 cibmon[15210]: 2007/09/19_15:38:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2509 cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:211:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2509 cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2510 cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2510 cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2511 cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 ERROR: cl_log: 89 messages were dropped cibmon[15210]: 2007/09/19_15:38:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2514 cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2515 cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2515 cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2516 cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - lrmd[4501]: 2007/09/19_15:38:12 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:11 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1641, rc=0) complete cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1643, rc=0) complete cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1644, rc=0) complete cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:11 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1642, rc=0) complete cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2516 cibmon[15210]: 2007/09/19_15:38:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2517 cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:12 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1645, rc=254) Error cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:38:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2521 cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2522 cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2522 crmd[15216]: 2007/09/19_15:38:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1646, rc=7) complete cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2523 cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2523 cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2524 cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2524 cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2525 cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2525 cibmon[15210]: 2007/09/19_15:38:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2526 cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:03 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 ERROR: cl_log: 63 messages were dropped cibmon[15210]: 2007/09/19_15:38:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2528 cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2529 cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2529 cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2530 cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2530 cibmon[15210]: 2007/09/19_15:38:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2531 cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:05 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:06 ERROR: cl_log: 148 messages were dropped crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:14 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:212:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2536 crmd[15216]: 2007/09/19_15:38:14 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1649, rc=0) complete cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2537 crmd[15216]: 2007/09/19_15:38:14 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1647, rc=0) complete cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:14 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1648, rc=0) complete cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:14 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1650, rc=0) complete cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2537 cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2538 cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - lrmd[4581]: 2007/09/19_15:38:15 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2538 cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2539 cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2539 cibmon[15210]: 2007/09/19_15:38:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2540 cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:06 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:38:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2544 cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2545 cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:15 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1651, rc=0) complete cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:15 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1653, rc=254) Error cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:15 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1654, rc=7) complete cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:15 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1652, rc=0) complete cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2545 cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2546 cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2546 cibmon[15210]: 2007/09/19_15:38:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2547 cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:16 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:07 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 ERROR: cl_log: 170 messages were dropped cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2553 cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2554 cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2554 cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2555 cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 ERROR: cl_log: 11 messages were dropped cibmon[15210]: 2007/09/19_15:38:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2555 cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2556 cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2556 cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2557 cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - lrmd[4705]: 2007/09/19_15:38:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:16 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:16 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:213:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1656, rc=0) complete cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1657, rc=0) complete cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1655, rc=0) complete cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1658, rc=0) complete cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:17 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1660, rc=0) complete cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2557 cibmon[15210]: 2007/09/19_15:38:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2558 cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:08 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 ERROR: cl_log: 90 messages were dropped cibmon[15210]: 2007/09/19_15:38:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2561 cibmon[15210]: 2007/09/19_15:38:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2562 cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1659, rc=0) complete cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1661, rc=254) Error cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1662, rc=7) complete cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2562 cibmon[15210]: 2007/09/19_15:38:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2563 cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:09 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 ERROR: cl_log: 61 messages were dropped cibmon[15210]: 2007/09/19_15:38:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2565 cibmon[15210]: 2007/09/19_15:38:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2566 cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:38:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2567 cibmon[15210]: 2007/09/19_15:38:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2568 cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:10 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:38:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2572 cibmon[15210]: 2007/09/19_15:38:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2573 cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:38:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2575 cibmon[15210]: 2007/09/19_15:38:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2576 cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:11 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2576 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2577 crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2577 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2578 cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:214:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1664, rc=0) complete cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1666, rc=0) complete cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1663, rc=0) complete cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1665, rc=0) complete cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2578 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2579 cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 ERROR: cl_log: 91 messages were dropped cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2582 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2583 cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - lrmd[4789]: 2007/09/19_15:38:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2583 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2584 cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2584 cibmon[15210]: 2007/09/19_15:38:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2585 cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:12 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 ERROR: cl_log: 34 messages were dropped cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2586 cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2587 cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1669, rc=254) Error cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1667, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1668, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:20 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1670, rc=7) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2587 cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2588 cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2588 cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2589 cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2589 cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2590 cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1673, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1671, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1672, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2590 crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2591 cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2591 cibmon[15210]: 2007/09/19_15:38:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2592 crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + lrmd[4856]: 2007/09/19_15:38:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:215:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1677, rc=254) Error cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:21 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1675, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1678, rc=7) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1676, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1674, rc=0) complete cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:14 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2592 cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2593 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2593 cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2594 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2594 cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2595 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:216:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1680, rc=0) complete cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1682, rc=0) complete cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 ERROR: cl_log: 8 messages were dropped cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2595 cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2596 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[4991]: 2007/09/19_15:38:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1681, rc=0) complete cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2596 crmd[15216]: 2007/09/19_15:38:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1679, rc=0) complete cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2597 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2597 cibmon[15210]: 2007/09/19_15:38:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2598 cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:15 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 ERROR: cl_log: 62 messages were dropped crmd[15216]: 2007/09/19_15:38:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1685, rc=254) Error cibmon[15210]: 2007/09/19_15:38:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1683, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2600 crmd[15216]: 2007/09/19_15:38:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1684, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2601 crmd[15216]: 2007/09/19_15:38:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1686, rc=7) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2601 cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2602 cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2602 cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2603 cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2603 cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2604 cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + lrmd[5086]: 2007/09/19_15:38:25 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1688, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1689, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1687, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1690, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:217:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1693, rc=254) Error cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:25 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1694, rc=7) complete cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1692, rc=0) complete cibmon[15210]: 2007/09/19_15:38:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2604 cibmon[15210]: 2007/09/19_15:38:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2605 cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:16 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 ERROR: cl_log: 209 messages were dropped cibmon[15210]: 2007/09/19_15:38:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2612 cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2613 cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1691, rc=0) complete cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2613 cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2614 cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2614 cibmon[15210]: 2007/09/19_15:38:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2615 lrmd[5175]: 2007/09/19_15:38:28 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:218:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1697, rc=0) complete cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1696, rc=0) complete cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1695, rc=0) complete cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1700, rc=0) complete cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:18 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2617 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2618 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:28 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1701, rc=254) Error cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1702, rc=7) complete cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:28 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1699, rc=0) complete cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1698, rc=0) complete cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2618 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2619 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2619 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2620 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2620 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2621 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2621 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2622 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2622 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2623 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2623 cibmon[15210]: 2007/09/19_15:38:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2624 cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:19 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 ERROR: cl_log: 34 messages were dropped cibmon[15210]: 2007/09/19_15:38:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2625 cibmon[15210]: 2007/09/19_15:38:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2626 cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:20 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2628 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2629 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2629 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2630 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - lrmd[5287]: 2007/09/19_15:38:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:219:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1706, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1705, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1704, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1703, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2630 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2631 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2631 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2632 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1709, rc=254) Error cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1707, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1710, rc=7) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:31 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1708, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2632 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2633 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2633 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2634 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2634 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2635 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 ERROR: cl_log: 36 messages were dropped cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2636 cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2637 cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + lrmd[5395]: 2007/09/19_15:38:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:38:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2637 crmd[15216]: 2007/09/19_15:38:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2638 crmd[15216]: 2007/09/19_15:38:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:220:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1713, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1712, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1711, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:33 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1714, rc=0) complete cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:21 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:38:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2643 cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2644 cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:34 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1717, rc=254) Error cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2644 cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2645 cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1715, rc=0) complete cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:34 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1718, rc=7) complete cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1716, rc=0) complete cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 ERROR: cl_log: 322 messages were dropped cibmon[15210]: 2007/09/19_15:38:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2656 cibmon[15210]: 2007/09/19_15:38:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2657 cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:23 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2657 cibmon[15210]: 2007/09/19_15:38:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2658 cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:221:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1719, rc=0) complete cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1721, rc=0) complete cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1720, rc=0) complete cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1722, rc=0) complete cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:24 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2664 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2665 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + lrmd[5489]: 2007/09/19_15:38:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2665 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2666 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2666 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2667 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2667 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2668 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1725, rc=254) Error cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1723, rc=0) complete cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1726, rc=7) complete cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:36 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1724, rc=0) complete cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2668 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2669 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2669 cibmon[15210]: 2007/09/19_15:38:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2670 cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:25 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:26 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:38:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2672 cibmon[15210]: 2007/09/19_15:38:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2673 cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - lrmd[5597]: 2007/09/19_15:38:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:222:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1729, rc=0) complete cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1728, rc=0) complete cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1727, rc=0) complete cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:38 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1730, rc=0) complete cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:26 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2682 cibmon[15210]: 2007/09/19_15:38:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2683 cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 ERROR: cl_log: 282 messages were dropped cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2683 cibmon[15210]: 2007/09/19_15:38:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2684 cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:27 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 ERROR: cl_log: 11 messages were dropped crmd[15216]: 2007/09/19_15:38:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1733, rc=254) Error cibmon[15210]: 2007/09/19_15:38:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:39 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1731, rc=0) complete cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2684 crmd[15216]: 2007/09/19_15:38:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1732, rc=0) complete cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2685 crmd[15216]: 2007/09/19_15:38:39 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1734, rc=7) complete cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:38:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2685 cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2686 cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:38:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2686 cibmon[15210]: 2007/09/19_15:38:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2687 cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:28 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 ERROR: cl_log: 263 messages were dropped cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2696 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2697 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2697 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2698 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2698 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2699 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + lrmd[5691]: 2007/09/19_15:38:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:223:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2699 crmd[15216]: 2007/09/19_15:38:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1737, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2700 crmd[15216]: 2007/09/19_15:38:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1735, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1736, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:41 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1738, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2700 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2701 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2701 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2702 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1739, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1741, rc=254) Error cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:42 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1740, rc=0) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1742, rc=7) complete cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2702 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2703 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2703 cibmon[15210]: 2007/09/19_15:38:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2704 cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:30 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 ERROR: cl_log: 154 messages were dropped cibmon[15210]: 2007/09/19_15:38:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2709 cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2710 cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2710 cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2711 cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - lrmd[5799]: 2007/09/19_15:38:44 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:224:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:43 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1745, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1744, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:43 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1743, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1746, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:44 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1749, rc=254) Error cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2711 cibmon[15210]: 2007/09/19_15:38:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2712 cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:44 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1747, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1750, rc=7) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1748, rc=0) complete cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:31 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 ERROR: cl_log: 3 messages were dropped cibmon[15210]: 2007/09/19_15:38:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2712 cibmon[15210]: 2007/09/19_15:38:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2713 cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:32 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2713 cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2714 cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2714 cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2715 cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2715 cibmon[15210]: 2007/09/19_15:38:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2716 cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: - lrmd[5909]: 2007/09/19_15:38:47 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:225:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1753, rc=0) complete cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1752, rc=0) complete cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1751, rc=0) complete cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1754, rc=0) complete cibmon[15210]: 2007/09/19_15:38:33 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1757, rc=254) Error cibmon[15210]: 2007/09/19_15:38:34 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:38:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2721 cibmon[15210]: 2007/09/19_15:38:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2722 cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1755, rc=0) complete cibmon[15210]: 2007/09/19_15:38:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2722 crmd[15216]: 2007/09/19_15:38:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1758, rc=7) complete cibmon[15210]: 2007/09/19_15:38:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2723 crmd[15216]: 2007/09/19_15:38:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1756, rc=0) complete cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:34 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 ERROR: cl_log: 147 messages were dropped cibmon[15210]: 2007/09/19_15:38:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2728 cibmon[15210]: 2007/09/19_15:38:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2729 cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2729 cibmon[15210]: 2007/09/19_15:38:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2730 cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:35 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:38:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2736 cibmon[15210]: 2007/09/19_15:38:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2737 cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2737 crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2738 crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + lrmd[6030]: 2007/09/19_15:38:50 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:226:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:36 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1761, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 ERROR: cl_log: 177 messages were dropped crmd[15216]: 2007/09/19_15:38:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1760, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1759, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2744 crmd[15216]: 2007/09/19_15:38:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1762, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2745 cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2745 cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2746 cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:50 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1765, rc=254) Error cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:38:50 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 40 ms (> 30 ms) (GSource: 0x8877298) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1763, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2746 cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2747 cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1766, rc=7) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1764, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2747 cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2748 cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + lrmd[6159]: 2007/09/19_15:38:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2748 crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2749 crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:227:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1768, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:52 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1769, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1767, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:52 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1770, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1771, rc=0) complete cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:38 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 ERROR: cl_log: 265 messages were dropped cibmon[15210]: 2007/09/19_15:38:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2758 crmd[15216]: 2007/09/19_15:38:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1773, rc=254) Error cibmon[15210]: 2007/09/19_15:38:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2759 cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:38:53 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:38:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1772, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + lrmd[6279]: 2007/09/19_15:38:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1774, rc=7) complete cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:228:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1777, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 ERROR: cl_log: 2 messages were dropped crmd[15216]: 2007/09/19_15:38:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1776, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1775, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2759 crmd[15216]: 2007/09/19_15:38:54 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1778, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2760 crmd[15216]: 2007/09/19_15:38:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1780, rc=0) complete cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:39 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2760 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2761 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1781, rc=254) Error cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + lrmd[15213]: 2007/09/19_15:38:55 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 70 ms (> 30 ms) (GSource: 0x8877298) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1779, rc=0) complete cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:55 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1782, rc=7) complete cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2761 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2762 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2762 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2763 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2763 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2764 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2764 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2765 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2765 cibmon[15210]: 2007/09/19_15:38:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2766 cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - lrmd[6390]: 2007/09/19_15:38:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:229:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:41 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1784, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 ERROR: cl_log: 65 messages were dropped crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1785, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1783, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2768 crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1787, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2769 crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1788, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1790, rc=7) complete cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1786, rc=0) complete cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1789, rc=254) Error cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2769 cibmon[15210]: 2007/09/19_15:38:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2770 cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:42 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:38:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2776 cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2777 cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2777 cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2778 cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2778 cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2779 cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + lrmd[6451]: 2007/09/19_15:38:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2779 crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2780 crmd[15216]: 2007/09/19_15:38:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:230:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1793, rc=0) complete cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1792, rc=0) complete cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1791, rc=0) complete cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:38:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1796, rc=0) complete cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:43 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 ERROR: cl_log: 237 messages were dropped cibmon[15210]: 2007/09/19_15:38:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2788 cibmon[15210]: 2007/09/19_15:38:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2789 cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2789 cibmon[15210]: 2007/09/19_15:38:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2790 cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1797, rc=254) Error cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1795, rc=0) complete cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1798, rc=7) complete cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:38:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1794, rc=0) complete cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=19:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:45 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 ERROR: cl_log: 61 messages were dropped cibmon[15210]: 2007/09/19_15:38:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2792 cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2793 cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=20:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2793 cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2794 cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=21:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2794 cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2795 cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - lrmd[6564]: 2007/09/19_15:39:01 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=22:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=23:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=24:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=25:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=26:231:b20505b8-340a-4d29-b05e-b896dffe089e) cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1801, rc=0) complete cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1800, rc=0) complete cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1799, rc=0) complete cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + crmd[15216]: 2007/09/19_15:39:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1802, rc=0) complete cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:39:01 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1805, rc=254) Error cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2795 cibmon[15210]: 2007/09/19_15:38:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2796 cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:46 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 ERROR: cl_log: 267 messages were dropped cibmon[15210]: 2007/09/19_15:38:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2805 cibmon[15210]: 2007/09/19_15:38:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2806 cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:48 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:38:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2808 cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2809 cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2809 cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2810 cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2810 crmd[15216]: 2007/09/19_15:39:01 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1803, rc=0) complete cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2811 crmd[15216]: 2007/09/19_15:39:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1804, rc=0) complete cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1806, rc=7) complete cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:02 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:02 info: crmd_client_status_callback: Got client status callback - our DC is dead cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:02 info: do_state_transition: State transition S_NOT_DC -> S_ELECTION [ input=I_ELECTION cause=C_CRMD_STATUS_CALLBACK origin=crmd_client_status_callback ] cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - crmd[15216]: 2007/09/19_15:39:02 info: update_dc: Set DC to () cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2811 cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2812 cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cib[15212]: 2007/09/19_15:39:02 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca crmd[15216]: 2007/09/19_15:39:02 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cib[15212]: 2007/09/19_15:39:03 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[15216]: 2007/09/19_15:39:02 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cib[15212]: 2007/09/19_15:39:03 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm crmd[15216]: 2007/09/19_15:39:02 info: do_election_check: Still waiting on 1 non-votes (2 total) cibmon[15210]: 2007/09/19_15:38:49 ERROR: cl_log: 5 messages were dropped cib[15212]: 2007/09/19_15:39:03 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[15216]: 2007/09/19_15:39:03 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm cibmon[15210]: 2007/09/19_15:38:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[15216]: 2007/09/19_15:39:03 info: mem_handle_event: instance=4, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2812 crmd[15216]: 2007/09/19_15:39:03 info: crmd_ccm_msg_callback: Quorum lost after event=NOT PRIMARY (id=4) cibmon[15210]: 2007/09/19_15:38:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2813 cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:49 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:38:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2816 cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2817 cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2817 cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2818 cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 ERROR: cl_log: 177 messages were dropped cibmon[15210]: 2007/09/19_15:38:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2824 cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2825 cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:38:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2825 cibmon[15210]: 2007/09/19_15:38:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2826 cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:51 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 ERROR: cl_log: 205 messages were dropped cibmon[15210]: 2007/09/19_15:38:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2833 cibmon[15210]: 2007/09/19_15:38:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2834 cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2834 cibmon[15210]: 2007/09/19_15:38:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2835 cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:53 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 ERROR: cl_log: 379 messages were dropped cibmon[15210]: 2007/09/19_15:38:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2848 cibmon[15210]: 2007/09/19_15:38:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2849 cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2849 cibmon[15210]: 2007/09/19_15:38:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2850 cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:55 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 ERROR: cl_log: 206 messages were dropped cibmon[15210]: 2007/09/19_15:38:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2857 cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2858 cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2858 cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2859 cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2859 cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2860 cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2860 cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2861 cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2861 cibmon[15210]: 2007/09/19_15:38:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2862 cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:56 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 ERROR: cl_log: 62 messages were dropped cibmon[15210]: 2007/09/19_15:38:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2864 cibmon[15210]: 2007/09/19_15:38:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2865 cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2865 cibmon[15210]: 2007/09/19_15:38:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2866 cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:57 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 ERROR: cl_log: 235 messages were dropped cibmon[15210]: 2007/09/19_15:38:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2874 cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2875 cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:38:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2876 cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2877 cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2877 cibmon[15210]: 2007/09/19_15:38:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2878 cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:58 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 ERROR: cl_log: 103 messages were dropped cibmon[15210]: 2007/09/19_15:38:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2882 cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2883 cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2883 cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2884 cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2884 cibmon[15210]: 2007/09/19_15:38:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2885 cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:38:59 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 ERROR: cl_log: 120 messages were dropped cibmon[15210]: 2007/09/19_15:39:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2889 cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2890 cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2890 cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2891 cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2891 cibmon[15210]: 2007/09/19_15:39:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2892 cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:00 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 ERROR: cl_log: 178 messages were dropped cibmon[15210]: 2007/09/19_15:39:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2898 cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2899 cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2899 cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2900 cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2900 cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2901 cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2901 cibmon[15210]: 2007/09/19_15:39:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2902 cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:01 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 ERROR: cl_log: 34 messages were dropped cibmon[15210]: 2007/09/19_15:39:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2903 cibmon[15210]: 2007/09/19_15:39:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2904 cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[15210]: 2007/09/19_15:39:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2904 cibmon[15210]: 2007/09/19_15:39:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2905 cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: - cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cibmon[15210]: 2007/09/19_15:39:02 info: log_data_element: cib_apply_diff: + cib[15212]: 2007/09/19_15:39:14 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[15212]: 2007/09/19_15:39:14 info: mem_handle_event: no mbr_track info cib[15212]: 2007/09/19_15:39:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm ccm[15211]: 2007/09/19_15:39:14 info: Break tie for 2 nodes cluster cib[15212]: 2007/09/19_15:39:14 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[15216]: 2007/09/19_15:39:14 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[15212]: 2007/09/19_15:39:14 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[15216]: 2007/09/19_15:39:14 info: mem_handle_event: no mbr_track info cib[15212]: 2007/09/19_15:39:14 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[15216]: 2007/09/19_15:39:14 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[15216]: 2007/09/19_15:39:14 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=5) crmd[15216]: 2007/09/19_15:39:14 info: ccm_event_detail: NEW MEMBERSHIP: trans=5, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 crmd[15216]: 2007/09/19_15:39:14 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=5] crmd[15216]: 2007/09/19_15:39:14 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=1] crmd[15216]: 2007/09/19_15:39:14 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[15216]: 2007/09/19_15:39:14 info: start_subsystem: Starting sub-system "tengine" crmd[15216]: 2007/09/19_15:39:14 info: start_subsystem: Starting sub-system "pengine" cibmon[15210]: 2007/09/19_15:39:14 ERROR: cl_log: 119 messages were dropped cibmon[15210]: 2007/09/19_15:39:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:14 info: log_cib_diff: cib_update: Local-only Change: 0.2.2909 cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:14 info: do_dc_takeover: Taking over DC status for this partition cib[15212]: 2007/09/19_15:39:14 info: cib_process_readwrite: We are now in R/W mode crmd[15216]: 2007/09/19_15:39:14 info: update_dc: Set DC to () crmd[15216]: 2007/09/19_15:39:14 info: join_make_offer: Making join offers based on membership 5 crmd[15216]: 2007/09/19_15:39:14 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cibmon[15210]: 2007/09/19_15:39:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:14 info: log_cib_diff: cib_update: Diff: --- 0.2.2909 cibmon[15210]: 2007/09/19_15:39:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.2910 cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:14 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:14 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[6639]: 2007/09/19_15:39:14 info: G_main_add_TriggerHandler: Added signal manual handler pengine[6640]: 2007/09/19_15:39:14 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[15212]: 2007/09/19_15:39:14 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on pengine[6640]: 2007/09/19_15:39:14 info: pe_init: Starting pengine tengine[6639]: 2007/09/19_15:39:14 info: te_init: Registering TE UUID: cdefb5a2-efb8-49af-83f0-5a7f0e624015 tengine[6639]: 2007/09/19_15:39:14 info: set_graph_functions: Setting custom graph functions tengine[6639]: 2007/09/19_15:39:14 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[6639]: 2007/09/19_15:39:14 info: te_init: Starting tengine crmd[15216]: 2007/09/19_15:39:14 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[15216]: 2007/09/19_15:39:15 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[15216]: 2007/09/19_15:39:15 info: do_state_transition: All 1 cluster nodes responded to the join offer. cib[15212]: 2007/09/19_15:39:15 info: sync_our_cib: Syncing CIB to all peers crmd[15216]: 2007/09/19_15:39:15 info: update_attrd: Connecting to attrd... attrd[15215]: 2007/09/19_15:39:15 info: attrd_local_callback: Sending full refresh cibmon[15210]: 2007/09/19_15:39:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: --- 0.2.2910 cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.2911 cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: --- 0.2.2911 cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.2912 cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:15 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;6:8:b20505b8-340a-4d29-b05e-b896dffe089e (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;8:8:b20505b8-340a-4d29-b05e-b896dffe089e (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;16:8:b20505b8-340a-4d29-b05e-b896dffe089e (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;10:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;12:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: build_operation_update: Digest for 0:0;14:8:b20505b8-340a-4d29-b05e-b896dffe089e (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[15216]: 2007/09/19_15:39:15 info: log_data_element: build_operation_update: digest:source crmd[15216]: 2007/09/19_15:39:15 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: --- 0.2.2912 tengine[6639]: 2007/09/19_15:39:15 info: process_graph_event: Action msg_last_monitor_0 initiated by a different transitioner cibmon[15210]: 2007/09/19_15:39:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.2913 tengine[6639]: 2007/09/19_15:39:15 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:15 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:15 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:15 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6640]: 2007/09/19_15:39:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:15 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:15 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:15 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:15 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca FAILED pengine[6640]: 2007/09/19_15:39:15 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:15 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: NoRoleChange: Recover resource mysql (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:15 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[6640]: 2007/09/19_15:39:15 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[6640]: 2007/09/19_15:39:15 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[6640]: 2007/09/19_15:39:15 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[6640]: 2007/09/19_15:39:15 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[6640]: 2007/09/19_15:39:16 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-34.bz2 pengine[6640]: 2007/09/19_15:39:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6640]: 2007/09/19_15:39:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:16 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:16 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:16 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:16 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca FAILED pengine[6640]: 2007/09/19_15:39:16 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:16 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: NoRoleChange: Recover resource mysql (host-1.awale.qc.ca) pengine[6640]: 2007/09/19_15:39:16 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[6640]: 2007/09/19_15:39:16 notice: StartRsc: host-1.awale.qc.ca Start mysql crmd[15216]: 2007/09/19_15:39:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:39:16 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[6640]: 2007/09/19_15:39:16 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[6640]: 2007/09/19_15:39:16 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[6640]: 2007/09/19_15:39:16 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-35.bz2 tengine[6639]: 2007/09/19_15:39:16 info: unpack_graph: Unpacked transition 1: 32 actions in 32 synapses tengine[6639]: 2007/09/19_15:39:16 info: te_pseudo_action: Pseudo action 36 fired and confirmed tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 10: msg_first_monitor_0 on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=10:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 11: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 12: share-drbd_monitor_0 on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=11:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 13: share-FS_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 14: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 15: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 16: mysql_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 17: msg_last_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:16 info: te_pseudo_action: Pseudo action 38 fired and confirmed tengine[6639]: 2007/09/19_15:39:16 info: send_rsc_command: Initiating action 6: mysql_stop_0 on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=12:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=13:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=14:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=15:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=16:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=17:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:16 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=6:1:cdefb5a2-efb8-49af-83f0-5a7f0e624015) lrmd[15213]: 2007/09/19_15:39:16 info: perform_op:2799: operations on resource mysql already delayed crmd[15216]: 2007/09/19_15:39:16 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1809, rc=0) complete cibmon[15210]: 2007/09/19_15:39:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: --- 0.2.2913 cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.2914 cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:16 info: match_graph_event: Action share-drbd_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:16 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1807, rc=0) complete cibmon[15210]: 2007/09/19_15:39:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:16 info: match_graph_event: Action msg_first_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: --- 0.2.2914 cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.2915 cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:16 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1808, rc=0) complete cibmon[15210]: 2007/09/19_15:39:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:16 info: match_graph_event: Action vmstat-mon_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: --- 0.2.2915 cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.2916 cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:16 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1810, rc=0) complete cibmon[15210]: 2007/09/19_15:39:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: --- 0.2.2916 cibmon[15210]: 2007/09/19_15:39:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.2917 tengine[6639]: 2007/09/19_15:39:16 info: match_graph_event: Action share-FS_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:16 info: log_data_element: cib_update: + lrmd[6704]: 2007/09/19_15:39:17 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:17 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1813, rc=254) Error lrmd[6705]: 2007/09/19_15:39:17 WARN: For LSB init script, no additional parameters are needed. lrmd[6705]: 2007/09/19_15:39:17 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:17 ERROR: process_lrm_event: LRM operation mysql_stop_0 (call=1815, rc=254) Error cibmon[15210]: 2007/09/19_15:39:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:17 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: --- 0.2.2917 tengine[6639]: 2007/09/19_15:39:17 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.2918 tengine[6639]: 2007/09/19_15:39:17 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:17 info: match_graph_event: Action mysql_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:17 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1811, rc=0) complete cibmon[15210]: 2007/09/19_15:39:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:17 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: --- 0.2.2918 tengine[6639]: 2007/09/19_15:39:17 info: match_graph_event: Action mysql_stop_0 (6) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.2919 cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: --- 0.2.2919 cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.2920 cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:17 info: match_graph_event: Action share-drbdlinks_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:17 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1812, rc=0) complete tengine[6639]: 2007/09/19_15:39:17 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: --- 0.2.2920 cibmon[15210]: 2007/09/19_15:39:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.2921 cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:17 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:39:18 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x8877298) lrmd[15213]: 2007/09/19_15:39:18 info: G_SIG_dispatch: started at 430113249 should have started at 430113149 crmd[15216]: 2007/09/19_15:39:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1814, rc=7) complete tengine[6639]: 2007/09/19_15:39:18 info: match_graph_event: Action msg_last_monitor_0 (17) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: --- 0.2.2921 cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.2922 tengine[6639]: 2007/09/19_15:39:18 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:18 notice: run_graph: Transition 1: (Complete=11, Pending=0, Fired=0, Skipped=20, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:18 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:18 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:18 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:18 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:18 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:18 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:18 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[6640]: 2007/09/19_15:39:18 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:18 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:18 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:18 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource msg_first cannot run anywhere crmd[15216]: 2007/09/19_15:39:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource share-drbd cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource share-FS cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource mysql cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 WARN: native_color: Resource msg_last cannot run anywhere pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[6640]: 2007/09/19_15:39:18 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[6640]: 2007/09/19_15:39:18 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[6639]: 2007/09/19_15:39:18 info: unpack_graph: Unpacked transition 2: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:18 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[6639]: 2007/09/19_15:39:18 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:18 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-20.bz2 tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:18 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:18 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:18 info: te_pseudo_action: Pseudo action 35 fired and confirmed crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:2:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1818, rc=0) complete cibmon[15210]: 2007/09/19_15:39:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: --- 0.2.2922 cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.2923 cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1816, rc=0) complete tengine[6639]: 2007/09/19_15:39:18 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: --- 0.2.2923 cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.2924 cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:18 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1817, rc=0) complete cibmon[15210]: 2007/09/19_15:39:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: --- 0.2.2924 cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.2925 cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:18 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1819, rc=0) complete cibmon[15210]: 2007/09/19_15:39:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:18 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: --- 0.2.2925 cibmon[15210]: 2007/09/19_15:39:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.2926 cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:19 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1821, rc=0) complete cibmon[15210]: 2007/09/19_15:39:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: --- 0.2.2926 cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.2927 cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:19 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + lrmd[6826]: 2007/09/19_15:39:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1822, rc=254) Error cibmon[15210]: 2007/09/19_15:39:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:19 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: --- 0.2.2927 tengine[6639]: 2007/09/19_15:39:19 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.2928 tengine[6639]: 2007/09/19_15:39:19 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:19 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1820, rc=0) complete cibmon[15210]: 2007/09/19_15:39:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: --- 0.2.2928 cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.2929 cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:19 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1823, rc=7) complete cibmon[15210]: 2007/09/19_15:39:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:19 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: --- 0.2.2929 tengine[6639]: 2007/09/19_15:39:19 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.2930 tengine[6639]: 2007/09/19_15:39:19 notice: run_graph: Transition 2: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:19 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6640]: 2007/09/19_15:39:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:19 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:19 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:19 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:39:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[6640]: 2007/09/19_15:39:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:19 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:19 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource msg_first cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource share-drbd cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource share-FS cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource mysql cannot run anywhere tengine[6639]: 2007/09/19_15:39:19 info: unpack_graph: Unpacked transition 3: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:19 WARN: native_color: Resource msg_last cannot run anywhere pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[6639]: 2007/09/19_15:39:19 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop share-FS crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:19 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:19 WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-21.bz2 tengine[6639]: 2007/09/19_15:39:19 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:3:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1826, rc=0) complete cibmon[15210]: 2007/09/19_15:39:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: --- 0.2.2930 cibmon[15210]: 2007/09/19_15:39:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.2931 cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:19 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1828, rc=0) complete cibmon[15210]: 2007/09/19_15:39:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: --- 0.2.2931 cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.2932 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:20 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1824, rc=0) complete cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1825, rc=0) complete cibmon[15210]: 2007/09/19_15:39:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:20 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: --- 0.2.2932 cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.2933 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: --- 0.2.2933 cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.2934 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:20 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1827, rc=0) complete cibmon[15210]: 2007/09/19_15:39:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: --- 0.2.2934 cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.2935 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:20 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + lrmd[6908]: 2007/09/19_15:39:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1830, rc=254) Error cibmon[15210]: 2007/09/19_15:39:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: --- 0.2.2935 cibmon[15210]: 2007/09/19_15:39:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.2936 tengine[6639]: 2007/09/19_15:39:20 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:20 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:20 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:20 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1831, rc=7) complete crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1829, rc=0) complete cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2936 cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2937 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:21 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2937 crmd[15216]: 2007/09/19_15:39:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:21 notice: run_graph: Transition 3: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2938 crmd[15216]: 2007/09/19_15:39:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6640]: 2007/09/19_15:39:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:21 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:21 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:21 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[6640]: 2007/09/19_15:39:21 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:21 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:21 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource msg_first cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource share-drbd cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource share-FS cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource mysql cannot run anywhere crmd[15216]: 2007/09/19_15:39:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:39:21 WARN: native_color: Resource msg_last cannot run anywhere pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[6640]: 2007/09/19_15:39:21 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[6640]: 2007/09/19_15:39:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:21 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[6640]: 2007/09/19_15:39:21 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:21 info: unpack_graph: Unpacked transition 4: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:21 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-22.bz2 tengine[6639]: 2007/09/19_15:39:21 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:21 info: te_pseudo_action: Pseudo action 35 fired and confirmed crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:4:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1834, rc=0) complete cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2938 cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2939 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1833, rc=0) complete crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1832, rc=0) complete cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2939 cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2940 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2940 cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2941 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1835, rc=0) complete cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:21 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1836, rc=0) complete cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2941 tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2942 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:21 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: --- 0.2.2942 cibmon[15210]: 2007/09/19_15:39:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.2943 cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:21 info: log_data_element: cib_update: + lrmd[7002]: 2007/09/19_15:39:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1838, rc=254) Error cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2943 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2944 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1837, rc=0) complete crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1839, rc=7) complete tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2944 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2945 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:22 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:22 notice: run_graph: Transition 4: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2945 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2946 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:22 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:22 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:22 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:22 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[6640]: 2007/09/19_15:39:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[6640]: 2007/09/19_15:39:22 WARN: custom_action: Action mysql_monitor_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:22 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld pengine[6640]: 2007/09/19_15:39:22 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource msg_first cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource share-drbd cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource share-FS cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource mysql cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 WARN: native_color: Resource msg_last cannot run anywhere pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[6640]: 2007/09/19_15:39:22 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[6640]: 2007/09/19_15:39:22 WARN: custom_action: Action mysql_stop_0 (unmanaged) pengine[6640]: 2007/09/19_15:39:22 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) pengine[6640]: 2007/09/19_15:39:22 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) crmd[15216]: 2007/09/19_15:39:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:39:22 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-23.bz2 pengine[6640]: 2007/09/19_15:39:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[6639]: 2007/09/19_15:39:22 info: unpack_graph: Unpacked transition 5: 19 actions in 19 synapses tengine[6639]: 2007/09/19_15:39:22 info: te_pseudo_action: Pseudo action 26 fired and confirmed tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:22 info: te_pseudo_action: Pseudo action 35 fired and confirmed crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:5:cdefb5a2-efb8-49af-83f0-5a7f0e624015) crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1841, rc=0) complete cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2946 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2947 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1840, rc=0) complete cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1842, rc=0) complete cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2947 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2948 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2948 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2949 cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1843, rc=0) complete cibmon[15210]: 2007/09/19_15:39:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: --- 0.2.2949 cibmon[15210]: 2007/09/19_15:39:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.2950 tengine[6639]: 2007/09/19_15:39:22 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:22 info: log_data_element: cib_update: + lrmd[7095]: 2007/09/19_15:39:23 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:23 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1846, rc=254) Error cibmon[15210]: 2007/09/19_15:39:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:23 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: --- 0.2.2950 tengine[6639]: 2007/09/19_15:39:23 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.2951 tengine[6639]: 2007/09/19_15:39:23 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:23 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1844, rc=0) complete cibmon[15210]: 2007/09/19_15:39:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: --- 0.2.2951 cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.2952 cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:23 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:23 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1847, rc=7) complete cibmon[15210]: 2007/09/19_15:39:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:23 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: --- 0.2.2952 cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.2953 cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:23 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1845, rc=0) complete tengine[6639]: 2007/09/19_15:39:23 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca tengine[6639]: 2007/09/19_15:39:23 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:23 notice: run_graph: Transition 5: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: --- 0.2.2953 cibmon[15210]: 2007/09/19_15:39:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.2954 cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:23 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[6640]: 2007/09/19_15:39:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[6640]: 2007/09/19_15:39:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[6640]: 2007/09/19_15:39:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[6640]: 2007/09/19_15:39:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[6640]: 2007/09/19_15:39:23 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[6640]: 2007/09/19_15:39:23 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[6640]: 2007/09/19_15:39:23 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: group_print: Resource Group: group-DW pengine[6640]: 2007/09/19_15:39:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed lrmd[15213]: 2007/09/19_15:39:24 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:39:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:24 info: unpack_graph: Unpacked transition 6: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: --- 0.2.2954 crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.2955 crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:6:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1850, rc=0) complete tengine[6639]: 2007/09/19_15:39:24 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:24 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1849, rc=0) complete tengine[6639]: 2007/09/19_15:39:24 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:24 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:23 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + lrmd[7189]: 2007/09/19_15:39:25 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:24 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1848, rc=0) complete tengine[6639]: 2007/09/19_15:39:24 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:24 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1851, rc=0) complete tengine[6639]: 2007/09/19_15:39:24 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:24 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:24 WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-24.bz2 cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:24 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: --- 0.2.2955 cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.2956 cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:25 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1854, rc=254) Error cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: --- 0.2.2956 cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.2957 cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: --- 0.2.2957 cibmon[15210]: 2007/09/19_15:39:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.2958 cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2958 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2959 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:25 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error tengine[6639]: 2007/09/19_15:39:25 info: update_abort_priority: Abort priority upgraded to 1 tengine[6639]: 2007/09/19_15:39:25 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1852, rc=0) complete crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1853, rc=0) complete cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2959 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2960 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1855, rc=7) complete tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:25 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 notice: run_graph: Transition 6: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: unpack_graph: Unpacked transition 7: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:25 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:25 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2960 crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2961 crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:7:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1858, rc=0) complete tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1856, rc=0) complete tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:25 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - lrmd[7297]: 2007/09/19_15:39:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1857, rc=0) complete tengine[6639]: 2007/09/19_15:39:25 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1859, rc=0) complete tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:25 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:25 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:25 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:25 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2961 pengine[6640]: 2007/09/19_15:39:25 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2962 pengine[6640]: 2007/09/19_15:39:25 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 WARN: process_pe_message: Transition 7: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-25.bz2 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:25 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2962 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2963 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2963 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2964 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1862, rc=254) Error tengine[6639]: 2007/09/19_15:39:26 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1861, rc=0) complete tengine[6639]: 2007/09/19_15:39:26 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1860, rc=0) complete tengine[6639]: 2007/09/19_15:39:26 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1863, rc=7) complete tengine[6639]: 2007/09/19_15:39:26 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:26 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:26 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2964 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2965 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: --- 0.2.2965 cibmon[15210]: 2007/09/19_15:39:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.2966 cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:26 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:26 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:26 notice: run_graph: Transition 7: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:26 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - lrmd[7393]: 2007/09/19_15:39:28 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:26 info: unpack_graph: Unpacked transition 8: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:8:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1864, rc=0) complete tengine[6639]: 2007/09/19_15:39:26 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1865, rc=0) complete tengine[6639]: 2007/09/19_15:39:26 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:26 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1866, rc=0) complete tengine[6639]: 2007/09/19_15:39:27 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:27 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1867, rc=0) complete tengine[6639]: 2007/09/19_15:39:27 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:27 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:27 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:26 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: --- 0.2.2966 pengine[6640]: 2007/09/19_15:39:26 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.2967 pengine[6640]: 2007/09/19_15:39:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1870, rc=254) Error tengine[6639]: 2007/09/19_15:39:28 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:26 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1868, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1869, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1871, rc=7) complete tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:26 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:28 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:28 notice: run_graph: Transition 8: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 WARN: process_pe_message: Transition 8: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-26.bz2 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:26 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: --- 0.2.2967 cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.2968 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:28 info: unpack_graph: Unpacked transition 9: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:9:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1874, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1873, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1872, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + lrmd[7489]: 2007/09/19_15:39:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1875, rc=0) complete tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:28 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:28 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: --- 0.2.2968 pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.2969 pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 WARN: process_pe_message: Transition 9: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-27.bz2 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: --- 0.2.2969 cibmon[15210]: 2007/09/19_15:39:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.2970 cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: --- 0.2.2970 cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.2971 cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: --- 0.2.2971 cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.2972 cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: --- 0.2.2972 cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.2973 cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: --- 0.2.2973 cibmon[15210]: 2007/09/19_15:39:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.2974 cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1876, rc=0) complete tengine[6639]: 2007/09/19_15:39:29 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1877, rc=0) complete tengine[6639]: 2007/09/19_15:39:29 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1878, rc=254) Error tengine[6639]: 2007/09/19_15:39:29 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1879, rc=7) complete tengine[6639]: 2007/09/19_15:39:29 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:29 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:29 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:29 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:29 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 notice: run_graph: Transition 9: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:29 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: unpack_graph: Unpacked transition 10: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:29 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:29 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2974 tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2975 tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - heartbeat[15200]: 2007/09/19_15:39:29 info: all clients are now paused cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:29 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:10:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:29 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:29 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:29 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1882, rc=0) complete tengine[6639]: 2007/09/19_15:39:29 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1880, rc=0) complete tengine[6639]: 2007/09/19_15:39:30 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1881, rc=0) complete tengine[6639]: 2007/09/19_15:39:30 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1883, rc=0) complete pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1885, rc=0) complete tengine[6639]: 2007/09/19_15:39:30 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:29 WARN: process_pe_message: Transition 10: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-28.bz2 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2975 pengine[6640]: 2007/09/19_15:39:29 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2976 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2976 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2977 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2977 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2978 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2978 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2979 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + lrmd[7608]: 2007/09/19_15:39:30 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:30 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1886, rc=254) Error tengine[6639]: 2007/09/19_15:39:30 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1884, rc=0) complete tengine[6639]: 2007/09/19_15:39:30 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1887, rc=7) complete tengine[6639]: 2007/09/19_15:39:30 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:30 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 notice: run_graph: Transition 10: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2979 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2980 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2980 cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2981 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - lrmd[7650]: 2007/09/19_15:39:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:31 info: unpack_graph: Unpacked transition 11: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:39:31 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 60 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:11:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1888, rc=0) complete tengine[6639]: 2007/09/19_15:39:31 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1894, rc=254) Error tengine[6639]: 2007/09/19_15:39:31 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:31 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1889, rc=0) complete tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1890, rc=0) complete tengine[6639]: 2007/09/19_15:39:31 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1895, rc=7) complete tengine[6639]: 2007/09/19_15:39:31 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1891, rc=0) complete tengine[6639]: 2007/09/19_15:39:31 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1892, rc=0) complete tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:31 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:31 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:31 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: --- 0.2.2981 pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.2982 pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - lrmd[7783]: 2007/09/19_15:39:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1893, rc=0) complete tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:32 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:32 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:32 notice: run_graph: Transition 11: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:31 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: unpack_graph: Unpacked transition 12: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:31 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:31 WARN: process_pe_message: Transition 11: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-29.bz2 cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:31 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:12:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1897, rc=0) complete tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1896, rc=0) complete tengine[6639]: 2007/09/19_15:39:32 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1898, rc=0) complete tengine[6639]: 2007/09/19_15:39:32 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:32 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1899, rc=0) complete tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:32 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: --- 0.2.2982 pengine[6640]: 2007/09/19_15:39:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.2983 pengine[6640]: 2007/09/19_15:39:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:32 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1900, rc=0) complete tengine[6639]: 2007/09/19_15:39:33 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1902, rc=254) Error tengine[6639]: 2007/09/19_15:39:33 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1901, rc=0) complete tengine[6639]: 2007/09/19_15:39:33 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1903, rc=7) complete tengine[6639]: 2007/09/19_15:39:33 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks heartbeat[15200]: 2007/09/19_15:39:33 WARN: node host-2.awale.qc.ca: is dead cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:33 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 heartbeat[15200]: 2007/09/19_15:39:33 info: Link host-2.awale.qc.ca:eth0 dead. cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:33 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:33 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:32 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:32 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 notice: run_graph: Transition 12: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:32 WARN: process_pe_message: Transition 12: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-30.bz2 cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: --- 0.2.2983 tengine[6639]: 2007/09/19_15:39:33 info: unpack_graph: Unpacked transition 13: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:32 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.2984 tengine[6639]: 2007/09/19_15:39:33 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:13:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:33 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:33 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] tengine[6639]: 2007/09/19_15:39:33 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:33 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:34 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1905, rc=0) complete tengine[6639]: 2007/09/19_15:39:33 info: te_update_diff: Aborting on transient_attributes deletions pengine[6640]: 2007/09/19_15:39:33 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:34 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1906, rc=0) complete tengine[6639]: 2007/09/19_15:39:33 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[6640]: 2007/09/19_15:39:33 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:34 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1904, rc=0) complete tengine[6639]: 2007/09/19_15:39:33 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1907, rc=0) complete tengine[6639]: 2007/09/19_15:39:34 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:34 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:34 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + lrmd[7877]: 2007/09/19_15:39:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:39:34 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: --- 0.2.2984 pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.2985 pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 WARN: process_pe_message: Transition 13: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-31.bz2 cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:33 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: --- 0.2.2985 cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.2986 cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: --- 0.2.2986 cibmon[15210]: 2007/09/19_15:39:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.2987 cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: --- 0.2.2987 cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.2988 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1910, rc=254) Error tengine[6639]: 2007/09/19_15:39:35 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1908, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1911, rc=7) complete tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: --- 0.2.2988 cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.2989 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + heartbeat[15200]: 2007/09/19_15:39:35 info: all clients are now resumed cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1909, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:35 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:35 notice: run_graph: Transition 13: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: unpack_graph: Unpacked transition 14: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:35 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: --- 0.2.2989 crmd[15216]: 2007/09/19_15:39:35 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:14:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.2990 crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1914, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1913, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1912, rc=0) complete heartbeat[15204]: 2007/09/19_15:39:35 WARN: Performed 1 more non-realtime malloc calls. cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1915, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca heartbeat[15204]: 2007/09/19_15:39:35 info: Total non-realtime malloc bytes: 139264 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca heartbeat[15206]: 2007/09/19_15:39:35 WARN: Performed 1 more non-realtime malloc calls. cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca heartbeat[15206]: 2007/09/19_15:39:35 info: Total non-realtime malloc bytes: 139264 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + lrmd[7998]: 2007/09/19_15:39:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:35 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1917, rc=0) complete tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:35 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: --- 0.2.2990 pengine[6640]: 2007/09/19_15:39:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.2991 pengine[6640]: 2007/09/19_15:39:35 WARN: process_pe_message: Transition 14: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-32.bz2 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:35 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: --- 0.2.2991 cibmon[15210]: 2007/09/19_15:39:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.2992 cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1918, rc=254) Error tengine[6639]: 2007/09/19_15:39:36 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1916, rc=0) complete tengine[6639]: 2007/09/19_15:39:36 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1919, rc=7) complete tengine[6639]: 2007/09/19_15:39:36 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2992 crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:36 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2993 crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 notice: run_graph: Transition 14: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:36 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: unpack_graph: Unpacked transition 15: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:36 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:36 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:15:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1922, rc=0) complete tengine[6639]: 2007/09/19_15:39:36 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1921, rc=0) complete tengine[6639]: 2007/09/19_15:39:36 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:36 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1920, rc=0) complete tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1924, rc=0) complete tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:36 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + lrmd[8080]: 2007/09/19_15:39:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:37 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1923, rc=0) complete tengine[6639]: 2007/09/19_15:39:37 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1926, rc=254) Error tengine[6639]: 2007/09/19_15:39:37 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:37 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:37 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:37 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:36 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:37 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2993 pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2994 pengine[6640]: 2007/09/19_15:39:36 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:36 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:36 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:36 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:36 WARN: process_pe_message: Transition 15: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-33.bz2 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:36 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + lrmd[8173]: 2007/09/19_15:39:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1925, rc=0) complete tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1927, rc=7) complete tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:38 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:38 notice: run_graph: Transition 15: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:38 info: unpack_graph: Unpacked transition 16: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:38 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2994 crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2995 crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:16:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1929, rc=0) complete tengine[6639]: 2007/09/19_15:39:38 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1930, rc=0) complete tengine[6639]: 2007/09/19_15:39:38 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1928, rc=0) complete tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:38 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1931, rc=0) complete tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:38 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:38 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:38 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:38 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2995 pengine[6640]: 2007/09/19_15:39:38 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2996 pengine[6640]: 2007/09/19_15:39:38 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 WARN: process_pe_message: Transition 16: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-34.bz2 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:38 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2996 cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2997 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2997 cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2998 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1934, rc=254) Error tengine[6639]: 2007/09/19_15:39:39 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1932, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1933, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1935, rc=7) complete tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:39 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:39 notice: run_graph: Transition 16: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2998 cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.2999 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:39 info: unpack_graph: Unpacked transition 17: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:39 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:39 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: --- 0.2.2999 crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3000 crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:17:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1938, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1937, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:39 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1936, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1939, rc=0) complete tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - lrmd[8267]: 2007/09/19_15:39:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:39:39 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:40 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1942, rc=254) Error pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 WARN: process_pe_message: Transition 17: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-35.bz2 cibmon[15210]: 2007/09/19_15:39:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:39 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3000 cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3001 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3001 cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3002 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3002 cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3003 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3003 cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3004 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1940, rc=0) complete tengine[6639]: 2007/09/19_15:39:40 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1941, rc=0) complete tengine[6639]: 2007/09/19_15:39:40 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:41 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1943, rc=7) complete tengine[6639]: 2007/09/19_15:39:40 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:40 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:40 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:41 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:41 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:41 notice: run_graph: Transition 17: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3004 cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3005 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:41 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3005 pengine[6640]: 2007/09/19_15:39:41 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3006 cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:39:41 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 60 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:39:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:41 info: unpack_graph: Unpacked transition 18: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:41 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:41 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:18:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1946, rc=0) complete tengine[6639]: 2007/09/19_15:39:41 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1945, rc=0) complete tengine[6639]: 2007/09/19_15:39:41 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:41 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1944, rc=0) complete tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + lrmd[8358]: 2007/09/19_15:39:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:41 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1949, rc=0) complete tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:41 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3006 pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3007 pengine[6640]: 2007/09/19_15:39:41 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:41 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:41 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:41 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:41 WARN: process_pe_message: Transition 18: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-36.bz2 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:41 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3007 cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3008 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3008 cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3009 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1948, rc=0) complete cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1950, rc=254) Error cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1951, rc=7) complete tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1947, rc=0) complete tengine[6639]: 2007/09/19_15:39:42 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:42 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:42 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:42 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 notice: run_graph: Transition 18: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:42 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: unpack_graph: Unpacked transition 19: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:42 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:42 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3009 crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3010 crmd[15216]: 2007/09/19_15:39:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:19:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1953, rc=0) complete tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1954, rc=0) complete tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - lrmd[8469]: 2007/09/19_15:39:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1952, rc=0) complete tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1955, rc=0) complete tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:42 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:42 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:43 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:42 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:42 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:33 info: log_cib_diff: cib_update: Local-only Change: 0.2.3010 pengine[6640]: 2007/09/19_15:39:42 WARN: process_pe_message: Transition 19: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-37.bz2 cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:42 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3010 cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3011 cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1958, rc=254) Error tengine[6639]: 2007/09/19_15:39:43 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1956, rc=0) complete tengine[6639]: 2007/09/19_15:39:43 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1957, rc=0) complete tengine[6639]: 2007/09/19_15:39:43 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1959, rc=7) complete tengine[6639]: 2007/09/19_15:39:43 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:43 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:43 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:43 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:43 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:44 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:43 notice: run_graph: Transition 19: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:44 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: unpack_graph: Unpacked transition 20: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:44 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:44 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + lrmd[8579]: 2007/09/19_15:39:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:20:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1962, rc=0) complete tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1961, rc=0) complete tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1960, rc=0) complete tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1963, rc=0) complete tengine[6639]: 2007/09/19_15:39:44 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1967, rc=7) complete tengine[6639]: 2007/09/19_15:39:44 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:44 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:44 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:44 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:44 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:44 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:44 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3011 pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3012 pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1966, rc=254) Error tengine[6639]: 2007/09/19_15:39:45 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:45 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:45 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:44 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 WARN: process_pe_message: Transition 20: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-38.bz2 cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:44 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3012 cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3013 cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3013 cibmon[15210]: 2007/09/19_15:39:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3014 cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1965, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1964, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:45 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:45 notice: run_graph: Transition 20: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:45 info: unpack_graph: Unpacked transition 21: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:45 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:34 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:35 ERROR: cl_log: 5 messages were dropped crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3014 crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3015 crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:21:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1970, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1969, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1975, rc=7) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1968, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:45 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1971, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:46 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1973, rc=0) complete tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:45 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:45 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:45 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:45 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3015 pengine[6640]: 2007/09/19_15:39:45 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3016 pengine[6640]: 2007/09/19_15:39:45 WARN: process_pe_message: Transition 21: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-39.bz2 cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:45 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3016 cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3017 cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3017 lrmd[8687]: 2007/09/19_15:39:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3018 cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:39:46 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:39:46 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1974, rc=254) Error tengine[6639]: 2007/09/19_15:39:46 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1972, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:46 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:46 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 notice: run_graph: Transition 21: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:46 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: unpack_graph: Unpacked transition 22: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:46 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:46 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3018 crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3019 crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:22:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1977, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - lrmd[8778]: 2007/09/19_15:39:47 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1978, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1976, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:47 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1979, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:46 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1981, rc=0) complete tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1982, rc=254) Error tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:46 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:47 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:47 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:47 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:47 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:47 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:47 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:46 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 ERROR: cl_log: 59 messages were dropped crmd[15216]: 2007/09/19_15:39:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1980, rc=0) complete tengine[6639]: 2007/09/19_15:39:47 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:48 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1983, rc=7) complete tengine[6639]: 2007/09/19_15:39:48 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3021 crmd[15216]: 2007/09/19_15:39:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:48 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:46 WARN: process_pe_message: Transition 22: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-40.bz2 cibmon[15210]: 2007/09/19_15:39:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3022 crmd[15216]: 2007/09/19_15:39:48 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:48 notice: run_graph: Transition 22: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:46 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:48 info: unpack_graph: Unpacked transition 23: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:23:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1986, rc=0) complete cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - lrmd[8859]: 2007/09/19_15:39:49 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:48 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1985, rc=0) complete tengine[6639]: 2007/09/19_15:39:48 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1984, rc=0) complete tengine[6639]: 2007/09/19_15:39:48 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:48 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1987, rc=0) complete tengine[6639]: 2007/09/19_15:39:48 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:48 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:48 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:48 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3023 pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3024 pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 WARN: process_pe_message: Transition 23: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-41.bz2 cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:48 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3024 cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3025 cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:39:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3026 cibmon[15210]: 2007/09/19_15:39:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3027 cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1990, rc=254) Error tengine[6639]: 2007/09/19_15:39:49 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1988, rc=0) complete tengine[6639]: 2007/09/19_15:39:49 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1989, rc=0) complete tengine[6639]: 2007/09/19_15:39:49 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1991, rc=7) complete tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:37 ERROR: cl_log: 146 messages were dropped crmd[15216]: 2007/09/19_15:39:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:37 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:37 info: log_cib_diff: cib_update: Diff: --- 0.2.3032 tengine[6639]: 2007/09/19_15:39:49 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:49 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_cib_diff: cib_update: Diff: +++ 0.2.3033 tengine[6639]: 2007/09/19_15:39:49 notice: run_graph: Transition 23: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:49 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: unpack_graph: Unpacked transition 24: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:49 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:49 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:49 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:24:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=1994, rc=0) complete tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=1993, rc=0) complete pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=1996, rc=0) complete pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=1992, rc=0) complete pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=1995, rc=0) complete pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:39 ERROR: cl_log: 146 messages were dropped pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3038 lrmd[8956]: 2007/09/19_15:39:50 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:39:49 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:49 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3039 pengine[6640]: 2007/09/19_15:39:49 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:49 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:49 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:49 WARN: process_pe_message: Transition 24: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-42.bz2 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:49 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:50 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=1998, rc=254) Error cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3039 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3040 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:50 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:50 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:50 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:50 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3040 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3041 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3041 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3042 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3042 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3043 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=1997, rc=0) complete cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:50 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:39:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3045 cibmon[15210]: 2007/09/19_15:39:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3046 cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=1999, rc=7) complete tengine[6639]: 2007/09/19_15:39:50 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:50 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:50 notice: run_graph: Transition 24: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:51 info: unpack_graph: Unpacked transition 25: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:25:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2002, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:40 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2000, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2004, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3046 crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2001, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3047 crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2003, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2005, rc=0) complete tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 WARN: process_pe_message: Transition 25: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-43.bz2 cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:51 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3047 cibmon[15210]: 2007/09/19_15:39:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3048 cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:39:52 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 140 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:39:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2006, rc=254) Error tengine[6639]: 2007/09/19_15:39:51 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:39:52 info: G_SIG_dispatch: started at 430116635 should have started at 430116621 crmd[15216]: 2007/09/19_15:39:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2007, rc=7) complete tengine[6639]: 2007/09/19_15:39:52 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + lrmd[9078]: 2007/09/19_15:39:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:52 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:40 info: log_data_element: cib_update: + lrmd[9160]: 2007/09/19_15:39:53 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:52 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:52 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3048 crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3049 crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:52 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 notice: run_graph: Transition 25: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:52 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: unpack_graph: Unpacked transition 26: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:52 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:52 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:26:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2010, rc=0) complete tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2008, rc=0) complete tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2009, rc=0) complete tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:52 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2011, rc=0) complete tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:52 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:52 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:52 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:52 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3049 pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3050 pengine[6640]: 2007/09/19_15:39:52 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:52 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:52 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:52 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:52 WARN: process_pe_message: Transition 26: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-44.bz2 cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:52 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3050 cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3051 cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2012, rc=0) complete tengine[6639]: 2007/09/19_15:39:53 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2014, rc=254) Error tengine[6639]: 2007/09/19_15:39:53 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2013, rc=0) complete tengine[6639]: 2007/09/19_15:39:53 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2015, rc=7) complete tengine[6639]: 2007/09/19_15:39:53 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:53 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:53 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:53 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:41 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:39:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:53 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:53 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3052 tengine[6639]: 2007/09/19_15:39:53 notice: run_graph: Transition 26: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:53 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3053 tengine[6639]: 2007/09/19_15:39:53 info: unpack_graph: Unpacked transition 27: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:53 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:53 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:53 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - lrmd[9254]: 2007/09/19_15:39:55 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:53 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:53 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:54 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:27:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:54 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2018, rc=0) complete tengine[6639]: 2007/09/19_15:39:54 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2016, rc=0) complete tengine[6639]: 2007/09/19_15:39:54 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2017, rc=0) complete tengine[6639]: 2007/09/19_15:39:54 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:54 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2019, rc=0) complete pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:42 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:53 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3054 pengine[6640]: 2007/09/19_15:39:53 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3055 pengine[6640]: 2007/09/19_15:39:53 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:53 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:53 WARN: process_pe_message: Transition 27: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-45.bz2 cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:53 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3055 cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3056 cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3056 cibmon[15210]: 2007/09/19_15:39:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3057 cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:42 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2020, rc=0) complete cibmon[15210]: 2007/09/19_15:39:43 ERROR: cl_log: 118 messages were dropped cibmon[15210]: 2007/09/19_15:39:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3061 cibmon[15210]: 2007/09/19_15:39:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3062 cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2022, rc=254) Error tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2021, rc=0) complete tengine[6639]: 2007/09/19_15:39:55 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2023, rc=7) complete tengine[6639]: 2007/09/19_15:39:55 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:55 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:55 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 notice: run_graph: Transition 27: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:55 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: unpack_graph: Unpacked transition 28: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:55 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:55 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 ERROR: cl_log: 1 messages were dropped tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3062 tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3063 tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:55 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:28:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2025, rc=0) complete pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2024, rc=0) complete pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2026, rc=0) complete pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:55 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2027, rc=0) complete pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:55 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:55 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:55 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:55 WARN: process_pe_message: Transition 28: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-46.bz2 cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + lrmd[9348]: 2007/09/19_15:39:56 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory pengine[6640]: 2007/09/19_15:39:55 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:39:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3067 cibmon[15210]: 2007/09/19_15:39:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3068 cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:39:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3072 cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3073 cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3073 cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3074 cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3074 cibmon[15210]: 2007/09/19_15:39:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3075 cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2028, rc=0) complete tengine[6639]: 2007/09/19_15:39:56 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2030, rc=254) Error tengine[6639]: 2007/09/19_15:39:56 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2029, rc=0) complete tengine[6639]: 2007/09/19_15:39:56 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:56 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:56 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 ERROR: cl_log: 116 messages were dropped cibmon[15210]: 2007/09/19_15:39:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3079 cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3080 cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2031, rc=7) complete tengine[6639]: 2007/09/19_15:39:56 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:56 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:56 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:56 notice: run_graph: Transition 28: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: unpack_graph: Unpacked transition 29: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:56 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:29:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2034, rc=0) complete tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2033, rc=0) complete tengine[6639]: 2007/09/19_15:39:56 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:57 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2032, rc=0) complete tengine[6639]: 2007/09/19_15:39:56 info: te_pseudo_action: Pseudo action 35 fired and confirmed cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + lrmd[9469]: 2007/09/19_15:39:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:57 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2035, rc=0) complete tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2037, rc=0) complete tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2038, rc=254) Error tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2036, rc=0) complete tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2039, rc=7) complete tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:39:57 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:56 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3080 tengine[6639]: 2007/09/19_15:39:57 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:56 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3081 tengine[6639]: 2007/09/19_15:39:57 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:56 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:57 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:58 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:56 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:58 notice: run_graph: Transition 29: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:56 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: unpack_graph: Unpacked transition 30: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:56 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:56 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 WARN: process_pe_message: Transition 29: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-47.bz2 cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:56 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:30:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2041, rc=0) complete tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2040, rc=0) complete tengine[6639]: 2007/09/19_15:39:58 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3081 lrmd[9553]: 2007/09/19_15:39:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2042, rc=0) complete tengine[6639]: 2007/09/19_15:39:58 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:58 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3082 crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2044, rc=0) complete tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2043, rc=0) complete tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2046, rc=254) Error tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:39:58 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:58 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3082 pengine[6640]: 2007/09/19_15:39:58 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3083 pengine[6640]: 2007/09/19_15:39:58 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 WARN: process_pe_message: Transition 30: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-48.bz2 cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:47 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:39:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3088 cibmon[15210]: 2007/09/19_15:39:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3089 cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:48 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2045, rc=0) complete cibmon[15210]: 2007/09/19_15:39:49 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:39:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3094 cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3095 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2047, rc=7) complete tengine[6639]: 2007/09/19_15:39:59 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:39:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:59 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:39:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:39:59 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:39:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:39:59 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:39:59 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 notice: run_graph: Transition 30: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:39:59 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: unpack_graph: Unpacked transition 31: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:39:59 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:39:59 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:31:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2050, rc=0) complete tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + lrmd[9645]: 2007/09/19_15:40:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:39:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2049, rc=0) complete tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:39:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2048, rc=0) complete tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2051, rc=0) complete tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:59 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:59 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:39:59 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:59 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:39:59 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:00 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:00 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3095 pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3096 pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:39:59 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:59 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:59 WARN: process_pe_message: Transition 31: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-49.bz2 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:39:59 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3096 cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3097 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3097 cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3098 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:39:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3102 cibmon[15210]: 2007/09/19_15:39:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3103 cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2054, rc=254) Error cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3103 cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3104 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2052, rc=0) complete tengine[6639]: 2007/09/19_15:40:00 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2053, rc=0) complete tengine[6639]: 2007/09/19_15:40:00 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2055, rc=7) complete tengine[6639]: 2007/09/19_15:40:00 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:00 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:01 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:01 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:01 notice: run_graph: Transition 31: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3104 cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3105 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:01 info: unpack_graph: Unpacked transition 32: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:01 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:01 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + lrmd[9741]: 2007/09/19_15:40:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:32:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2057, rc=0) complete tengine[6639]: 2007/09/19_15:40:01 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2058, rc=0) complete tengine[6639]: 2007/09/19_15:40:01 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:01 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2056, rc=0) complete tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2059, rc=0) complete tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3105 tengine[6639]: 2007/09/19_15:40:01 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3106 pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:01 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:01 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:01 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:01 WARN: process_pe_message: Transition 32: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-50.bz2 cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:01 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3106 cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3107 cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3107 cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3108 cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:02 info: perform_op:2783: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2060, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - lrmd[9840]: 2007/09/19_15:40:03 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2062, rc=254) Error tengine[6639]: 2007/09/19_15:40:02 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2061, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2063, rc=7) complete tengine[6639]: 2007/09/19_15:40:02 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:02 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 notice: run_graph: Transition 32: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:02 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: unpack_graph: Unpacked transition 33: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:02 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:02 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:33:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2066, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2065, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2064, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2069, rc=0) complete tengine[6639]: 2007/09/19_15:40:02 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3108 tengine[6639]: 2007/09/19_15:40:02 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:02 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3109 tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:02 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 WARN: process_pe_message: Transition 33: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-51.bz2 cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:39:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3111 cibmon[15210]: 2007/09/19_15:39:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3112 cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:03 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2067, rc=0) complete cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:52 info: log_cib_diff: cib_update: Diff: --- 0.2.3112 cibmon[15210]: 2007/09/19_15:39:52 info: log_cib_diff: cib_update: Diff: +++ 0.2.3113 cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:03 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:39:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3118 cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3119 cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3119 crmd[15216]: 2007/09/19_15:40:03 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2068, rc=0) complete tengine[6639]: 2007/09/19_15:40:03 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3120 crmd[15216]: 2007/09/19_15:40:03 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2070, rc=254) Error tengine[6639]: 2007/09/19_15:40:04 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2071, rc=7) complete tengine[6639]: 2007/09/19_15:40:04 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:04 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:04 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 notice: run_graph: Transition 33: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:04 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: unpack_graph: Unpacked transition 34: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:04 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:04 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + lrmd[9899]: 2007/09/19_15:40:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:34:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2073, rc=0) complete tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2078, rc=254) Error tengine[6639]: 2007/09/19_15:40:04 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2074, rc=0) complete tengine[6639]: 2007/09/19_15:40:04 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:04 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2072, rc=0) complete tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2079, rc=7) complete tengine[6639]: 2007/09/19_15:40:04 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:04 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:04 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2075, rc=0) complete tengine[6639]: 2007/09/19_15:40:04 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:04 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:04 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3120 pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3121 pengine[6640]: 2007/09/19_15:40:04 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2076, rc=0) complete tengine[6639]: 2007/09/19_15:40:04 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:04 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 WARN: process_pe_message: Transition 34: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-52.bz2 cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:04 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3126 cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3127 cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3127 cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3128 cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2077, rc=0) complete cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3128 cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3129 cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + lrmd[10038]: 2007/09/19_15:40:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:05 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:05 notice: run_graph: Transition 34: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: unpack_graph: Unpacked transition 35: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3129 crmd[15216]: 2007/09/19_15:40:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:35:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3130 crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2080, rc=0) complete tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2082, rc=0) complete tengine[6639]: 2007/09/19_15:40:05 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2081, rc=0) complete tengine[6639]: 2007/09/19_15:40:05 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2083, rc=0) complete tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:05 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:05 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:05 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:55 ERROR: cl_log: 2 messages were dropped pengine[6640]: 2007/09/19_15:40:05 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:05 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3130 pengine[6640]: 2007/09/19_15:40:05 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3131 pengine[6640]: 2007/09/19_15:40:05 WARN: process_pe_message: Transition 35: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-53.bz2 cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:05 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:39:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3133 cibmon[15210]: 2007/09/19_15:39:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3134 cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:39:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3134 cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3135 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2086, rc=254) Error tengine[6639]: 2007/09/19_15:40:06 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2084, rc=0) complete tengine[6639]: 2007/09/19_15:40:06 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2085, rc=0) complete tengine[6639]: 2007/09/19_15:40:06 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2087, rc=7) complete tengine[6639]: 2007/09/19_15:40:06 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:06 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:06 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3135 cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3136 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:06 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:06 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:06 notice: run_graph: Transition 35: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:06 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:06 info: unpack_graph: Unpacked transition 36: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:36:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2089, rc=0) complete tengine[6639]: 2007/09/19_15:40:06 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2090, rc=0) complete tengine[6639]: 2007/09/19_15:40:06 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:06 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2088, rc=0) complete tengine[6639]: 2007/09/19_15:40:07 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2091, rc=0) complete tengine[6639]: 2007/09/19_15:40:07 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2093, rc=0) complete tengine[6639]: 2007/09/19_15:40:07 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3136 tengine[6639]: 2007/09/19_15:40:07 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3137 pengine[6640]: 2007/09/19_15:40:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - lrmd[10159]: 2007/09/19_15:40:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2094, rc=254) Error tengine[6639]: 2007/09/19_15:40:07 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2092, rc=0) complete tengine[6639]: 2007/09/19_15:40:08 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:06 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2095, rc=7) complete tengine[6639]: 2007/09/19_15:40:08 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:06 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:08 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:06 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 notice: run_graph: Transition 36: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: unpack_graph: Unpacked transition 37: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:37:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2098, rc=0) complete tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2097, rc=0) complete tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2096, rc=0) complete tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2103, rc=7) complete tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:08 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2099, rc=0) complete tengine[6639]: 2007/09/19_15:40:08 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:08 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:06 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:06 WARN: process_pe_message: Transition 36: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-54.bz2 cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:06 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3137 pengine[6640]: 2007/09/19_15:40:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3138 pengine[6640]: 2007/09/19_15:40:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - lrmd[10263]: 2007/09/19_15:40:09 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:08 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:08 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2102, rc=254) Error pengine[6640]: 2007/09/19_15:40:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:56 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:57 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3142 pengine[6640]: 2007/09/19_15:40:08 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3143 pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 WARN: process_pe_message: Transition 37: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-55.bz2 cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:08 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:09 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:09 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:09 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:58 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:39:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3145 cibmon[15210]: 2007/09/19_15:39:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3146 cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2100, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2101, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:09 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:09 notice: run_graph: Transition 37: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:09 info: unpack_graph: Unpacked transition 38: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:09 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 ERROR: cl_log: 146 messages were dropped crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3151 crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3152 crmd[15216]: 2007/09/19_15:40:09 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:38:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2106, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2105, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2104, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2107, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2108, rc=0) complete tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:09 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:09 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:09 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - lrmd[10335]: 2007/09/19_15:40:10 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:09 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:09 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:39:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:09 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3152 pengine[6640]: 2007/09/19_15:40:09 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3153 pengine[6640]: 2007/09/19_15:40:09 WARN: process_pe_message: Transition 38: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-56.bz2 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:09 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3153 cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3154 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:10 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2110, rc=254) Error cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:39:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3155 cibmon[15210]: 2007/09/19_15:39:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3156 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:10 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:10 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:10 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:10 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:39:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3158 cibmon[15210]: 2007/09/19_15:40:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3159 cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3159 cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3160 cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:10 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2109, rc=0) complete tengine[6639]: 2007/09/19_15:40:10 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:10 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2111, rc=7) complete tengine[6639]: 2007/09/19_15:40:10 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:10 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:10 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:10 notice: run_graph: Transition 38: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:10 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3160 pengine[6640]: 2007/09/19_15:40:10 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3161 crmd[15216]: 2007/09/19_15:40:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:11 info: unpack_graph: Unpacked transition 39: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:10 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:10 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:39:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2114, rc=0) complete tengine[6639]: 2007/09/19_15:40:11 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2113, rc=0) complete tengine[6639]: 2007/09/19_15:40:11 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:10 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2112, rc=0) complete tengine[6639]: 2007/09/19_15:40:11 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:11 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2115, rc=0) complete tengine[6639]: 2007/09/19_15:40:11 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:11 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + lrmd[10428]: 2007/09/19_15:40:12 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:11 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:10 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:10 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3161 pengine[6640]: 2007/09/19_15:40:10 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3162 pengine[6640]: 2007/09/19_15:40:11 WARN: process_pe_message: Transition 39: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-57.bz2 cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:11 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3162 cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3163 cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3163 cibmon[15210]: 2007/09/19_15:40:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3164 cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3166 cibmon[15210]: 2007/09/19_15:40:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3167 cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2116, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:12 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2118, rc=254) Error tengine[6639]: 2007/09/19_15:40:12 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2119, rc=7) complete tengine[6639]: 2007/09/19_15:40:12 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3167 crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2117, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3168 crmd[15216]: 2007/09/19_15:40:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:12 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - lrmd[10549]: 2007/09/19_15:40:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 notice: run_graph: Transition 39: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:12 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: unpack_graph: Unpacked transition 40: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:12 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:12 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:40:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2122, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2121, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2120, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:12 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2123, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2125, rc=0) complete tengine[6639]: 2007/09/19_15:40:12 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:12 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:12 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:13 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:02 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:12 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 ERROR: cl_log: 175 messages were dropped pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3174 pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3175 pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 WARN: process_pe_message: Transition 40: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-58.bz2 cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:12 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2126, rc=254) Error tengine[6639]: 2007/09/19_15:40:13 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3175 crmd[15216]: 2007/09/19_15:40:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2124, rc=0) complete tengine[6639]: 2007/09/19_15:40:13 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3176 crmd[15216]: 2007/09/19_15:40:13 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2127, rc=7) complete tengine[6639]: 2007/09/19_15:40:13 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:13 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:13 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:13 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 notice: run_graph: Transition 40: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:13 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: unpack_graph: Unpacked transition 41: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:13 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:13 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:41:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2130, rc=0) complete tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:14 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2129, rc=0) complete tengine[6639]: 2007/09/19_15:40:13 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:14 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2128, rc=0) complete tengine[6639]: 2007/09/19_15:40:13 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:13 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:13 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2135, rc=7) complete pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:13 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3176 pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3177 pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - lrmd[10651]: 2007/09/19_15:40:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:14 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2131, rc=0) complete tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:13 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 WARN: process_pe_message: Transition 41: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-59.bz2 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:13 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2134, rc=254) Error cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3177 cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3178 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3178 cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3179 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2132, rc=0) complete cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3179 cibmon[15210]: 2007/09/19_15:40:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3180 cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:14 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:40:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3184 cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3185 cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3185 cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3186 cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:15 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2133, rc=0) complete tengine[6639]: 2007/09/19_15:40:15 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:15 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:15 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:15 notice: run_graph: Transition 41: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:15 info: unpack_graph: Unpacked transition 42: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:42:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2138, rc=0) complete tengine[6639]: 2007/09/19_15:40:15 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:15 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3186 cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3187 lrmd[10725]: 2007/09/19_15:40:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2137, rc=0) complete tengine[6639]: 2007/09/19_15:40:15 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2136, rc=0) complete tengine[6639]: 2007/09/19_15:40:15 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2139, rc=0) complete tengine[6639]: 2007/09/19_15:40:15 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:15 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:15 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 WARN: process_pe_message: Transition 42: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-60.bz2 cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:15 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3187 cibmon[15210]: 2007/09/19_15:40:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3188 cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3190 cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3191 cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3191 cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3192 cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3192 cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3193 cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:06 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2140, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3193 crmd[15216]: 2007/09/19_15:40:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2142, rc=254) Error tengine[6639]: 2007/09/19_15:40:16 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3194 crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2141, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2143, rc=7) complete tengine[6639]: 2007/09/19_15:40:16 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:16 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 notice: run_graph: Transition 42: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:16 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: unpack_graph: Unpacked transition 43: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:16 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:16 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:16 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:43:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: - lrmd[10833]: 2007/09/19_15:40:17 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2145, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2146, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2144, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2149, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2147, rc=0) complete tengine[6639]: 2007/09/19_15:40:16 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:16 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:17 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2150, rc=254) Error tengine[6639]: 2007/09/19_15:40:16 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:17 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:07 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:07 info: log_cib_diff: cib_update: Diff: --- 0.2.3198 pengine[6640]: 2007/09/19_15:40:16 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.3199 pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:17 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2148, rc=0) complete tengine[6639]: 2007/09/19_15:40:17 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:17 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2151, rc=7) complete tengine[6639]: 2007/09/19_15:40:17 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:16 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:17 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:16 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:17 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:17 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:17 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:17 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:16 WARN: process_pe_message: Transition 43: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-61.bz2 cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:17 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:16 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:17 notice: run_graph: Transition 43: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:18 info: unpack_graph: Unpacked transition 44: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:18 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:44:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + lrmd[10957]: 2007/09/19_15:40:19 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2154, rc=0) complete tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2153, rc=0) complete tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2152, rc=0) complete tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2157, rc=0) complete tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2159, rc=7) complete tengine[6639]: 2007/09/19_15:40:18 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2155, rc=0) complete tengine[6639]: 2007/09/19_15:40:18 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:17 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:07 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:08 ERROR: cl_log: 88 messages were dropped tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:08 info: log_cib_diff: cib_update: Diff: --- 0.2.3202 tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.3203 tengine[6639]: 2007/09/19_15:40:18 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:17 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:17 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:18 WARN: process_pe_message: Transition 44: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-62.bz2 cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:18 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:40:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3207 cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3208 cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:19 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2158, rc=254) Error cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2156, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:19 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:19 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:19 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 notice: run_graph: Transition 44: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:19 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: unpack_graph: Unpacked transition 45: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:19 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:19 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3208 crmd[15216]: 2007/09/19_15:40:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:45:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3209 crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2162, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - lrmd[11025]: 2007/09/19_15:40:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2161, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2160, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2164, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:19 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2163, rc=0) complete tengine[6639]: 2007/09/19_15:40:19 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:19 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3209 pengine[6640]: 2007/09/19_15:40:19 WARN: process_pe_message: Transition 45: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-63.bz2 cibmon[15210]: 2007/09/19_15:40:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3210 pengine[6640]: 2007/09/19_15:40:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:40:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3215 cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3216 cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3216 cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3217 cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3217 cibmon[15210]: 2007/09/19_15:40:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3218 cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2166, rc=254) Error tengine[6639]: 2007/09/19_15:40:20 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2165, rc=0) complete tengine[6639]: 2007/09/19_15:40:20 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2167, rc=7) complete tengine[6639]: 2007/09/19_15:40:20 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:20 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:20 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:20 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:20 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 notice: run_graph: Transition 45: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:20 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: unpack_graph: Unpacked transition 46: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:20 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:20 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3218 tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3219 lrmd[11119]: 2007/09/19_15:40:21 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:20 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:46:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:20 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2170, rc=0) complete tengine[6639]: 2007/09/19_15:40:21 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2169, rc=0) complete tengine[6639]: 2007/09/19_15:40:21 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2168, rc=0) complete pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:21 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2171, rc=0) complete pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 WARN: process_pe_message: Transition 46: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-64.bz2 cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3219 cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3220 cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:21 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2174, rc=254) Error cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3220 cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3221 cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3221 cibmon[15210]: 2007/09/19_15:40:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3222 cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3222 cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3223 cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3223 cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3224 cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + lrmd[11218]: 2007/09/19_15:40:23 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2175, rc=7) complete tengine[6639]: 2007/09/19_15:40:22 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2173, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2172, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:22 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 notice: run_graph: Transition 46: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:22 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: unpack_graph: Unpacked transition 47: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:22 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3224 crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:22 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3225 crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:47:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2178, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2176, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2177, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2179, rc=0) complete tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:22 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:22 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:22 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:22 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3225 pengine[6640]: 2007/09/19_15:40:22 WARN: process_pe_message: Transition 47: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-65.bz2 cibmon[15210]: 2007/09/19_15:40:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3226 pengine[6640]: 2007/09/19_15:40:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2180, rc=0) complete cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:23 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 120 ms (> 30 ms) (GSource: 0x8877298) cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2181, rc=0) complete tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2182, rc=254) Error tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2183, rc=7) complete tengine[6639]: 2007/09/19_15:40:23 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:23 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:23 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:13 ERROR: cl_log: 146 messages were dropped crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:23 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 notice: run_graph: Transition 47: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:23 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3231 crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: unpack_graph: Unpacked transition 48: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3232 tengine[6639]: 2007/09/19_15:40:23 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:23 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - lrmd[11303]: 2007/09/19_15:40:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:48:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2186, rc=0) complete tengine[6639]: 2007/09/19_15:40:23 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2185, rc=0) complete tengine[6639]: 2007/09/19_15:40:23 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:23 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2184, rc=0) complete tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2189, rc=0) complete tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:23 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:24 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:23 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3232 pengine[6640]: 2007/09/19_15:40:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3233 pengine[6640]: 2007/09/19_15:40:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:23 WARN: process_pe_message: Transition 48: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-66.bz2 cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:23 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:40:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3237 cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3238 cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3239 cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3240 cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3240 cibmon[15210]: 2007/09/19_15:40:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3241 cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3241 cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3242 cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:24 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2187, rc=0) complete cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2190, rc=254) Error tengine[6639]: 2007/09/19_15:40:24 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2188, rc=0) complete tengine[6639]: 2007/09/19_15:40:25 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2191, rc=7) complete tengine[6639]: 2007/09/19_15:40:25 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:25 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:25 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 notice: run_graph: Transition 48: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:25 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:40:25 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:25 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3242 pengine[6640]: 2007/09/19_15:40:25 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3243 tengine[6639]: 2007/09/19_15:40:25 info: unpack_graph: Unpacked transition 49: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:25 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:25 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:49:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - lrmd[11415]: 2007/09/19_15:40:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2194, rc=0) complete tengine[6639]: 2007/09/19_15:40:25 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2193, rc=0) complete tengine[6639]: 2007/09/19_15:40:25 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2192, rc=0) complete tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2195, rc=0) complete tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:25 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 WARN: process_pe_message: Transition 49: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-67.bz2 cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:25 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3243 cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3244 cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3244 cibmon[15210]: 2007/09/19_15:40:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3245 cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3246 cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3247 cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3247 cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3248 cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3248 cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3249 cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3249 cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3250 cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2198, rc=254) Error tengine[6639]: 2007/09/19_15:40:26 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2196, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2199, rc=7) complete tengine[6639]: 2007/09/19_15:40:26 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2197, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:26 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 notice: run_graph: Transition 49: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:26 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: unpack_graph: Unpacked transition 50: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:26 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:26 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3250 crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3251 crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:50:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - lrmd[11509]: 2007/09/19_15:40:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2202, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2201, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2200, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:27 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2203, rc=0) complete tengine[6639]: 2007/09/19_15:40:26 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:26 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:26 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:26 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:27 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:26 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2206, rc=254) Error tengine[6639]: 2007/09/19_15:40:27 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:17 ERROR: cl_log: 117 messages were dropped crmd[15216]: 2007/09/19_15:40:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2204, rc=0) complete tengine[6639]: 2007/09/19_15:40:27 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2205, rc=0) complete tengine[6639]: 2007/09/19_15:40:27 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3255 crmd[15216]: 2007/09/19_15:40:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2207, rc=7) complete tengine[6639]: 2007/09/19_15:40:27 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 WARN: process_pe_message: Transition 50: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-68.bz2 cibmon[15210]: 2007/09/19_15:40:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3256 crmd[15216]: 2007/09/19_15:40:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:27 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:26 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:27 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:27 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:27 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:27 notice: run_graph: Transition 50: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: unpack_graph: Unpacked transition 51: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:28 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:51:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2209, rc=0) complete tengine[6639]: 2007/09/19_15:40:28 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2208, rc=0) complete tengine[6639]: 2007/09/19_15:40:28 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2210, rc=0) complete tengine[6639]: 2007/09/19_15:40:28 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:28 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2211, rc=0) complete tengine[6639]: 2007/09/19_15:40:28 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:28 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2213, rc=0) complete tengine[6639]: 2007/09/19_15:40:28 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:28 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:28 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: log_cib_diff: cib_update: Diff: --- 0.2.3260 pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.3261 pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 WARN: process_pe_message: Transition 51: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-69.bz2 cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:40:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3264 cibmon[15210]: 2007/09/19_15:40:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3265 cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3265 cibmon[15210]: 2007/09/19_15:40:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3266 cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - lrmd[11630]: 2007/09/19_15:40:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2214, rc=254) Error tengine[6639]: 2007/09/19_15:40:29 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2212, rc=0) complete tengine[6639]: 2007/09/19_15:40:29 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2215, rc=7) complete tengine[6639]: 2007/09/19_15:40:29 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:29 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:29 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:29 notice: run_graph: Transition 51: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:40:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3271 cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3272 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:29 info: unpack_graph: Unpacked transition 52: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:29 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:52:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2218, rc=0) complete tengine[6639]: 2007/09/19_15:40:29 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2217, rc=0) complete tengine[6639]: 2007/09/19_15:40:29 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3272 crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2216, rc=0) complete tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3273 crmd[15216]: 2007/09/19_15:40:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2219, rc=0) complete tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - lrmd[11711]: 2007/09/19_15:40:30 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:29 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:29 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 WARN: process_pe_message: Transition 52: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-70.bz2 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:29 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3273 cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3274 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3274 cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3275 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3275 cibmon[15210]: 2007/09/19_15:40:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3276 cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3278 cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3279 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2220, rc=0) complete tengine[6639]: 2007/09/19_15:40:30 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2222, rc=254) Error tengine[6639]: 2007/09/19_15:40:30 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2221, rc=0) complete tengine[6639]: 2007/09/19_15:40:30 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2223, rc=7) complete tengine[6639]: 2007/09/19_15:40:30 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:30 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:30 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:30 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:30 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:30 notice: run_graph: Transition 52: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3279 crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: unpack_graph: Unpacked transition 53: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3280 crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:53:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2226, rc=0) complete tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:31 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2225, rc=0) complete tengine[6639]: 2007/09/19_15:40:30 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2228, rc=0) complete tengine[6639]: 2007/09/19_15:40:30 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:31 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:31 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - lrmd[11806]: 2007/09/19_15:40:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:31 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2224, rc=0) complete tengine[6639]: 2007/09/19_15:40:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:31 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2227, rc=0) complete tengine[6639]: 2007/09/19_15:40:31 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:31 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:30 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:30 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3280 pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3281 pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 WARN: process_pe_message: Transition 53: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-71.bz2 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:30 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:32 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2230, rc=254) Error cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3281 cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3282 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3282 cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3283 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:32 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:32 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:32 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed lrmd[11900]: 2007/09/19_15:40:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2229, rc=0) complete tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3283 crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2231, rc=7) complete tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3284 crmd[15216]: 2007/09/19_15:40:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:32 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:32 notice: run_graph: Transition 53: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:32 info: unpack_graph: Unpacked transition 54: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:32 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:54:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2234, rc=0) complete tengine[6639]: 2007/09/19_15:40:32 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2232, rc=0) complete tengine[6639]: 2007/09/19_15:40:32 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2233, rc=0) complete tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2235, rc=0) complete tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:32 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:32 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 ERROR: cl_log: 59 messages were dropped pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:32 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3286 pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3287 pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 WARN: process_pe_message: Transition 54: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-72.bz2 cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:32 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2236, rc=0) complete tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2238, rc=254) Error tengine[6639]: 2007/09/19_15:40:33 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2237, rc=0) complete tengine[6639]: 2007/09/19_15:40:33 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2239, rc=7) complete tengine[6639]: 2007/09/19_15:40:33 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:33 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 notice: run_graph: Transition 54: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:33 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:33 info: unpack_graph: Unpacked transition 55: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:33 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:33 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:33 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3287 crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3288 crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:55:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:33 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:33 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2242, rc=0) complete tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2241, rc=0) complete tengine[6639]: 2007/09/19_15:40:33 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:33 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2244, rc=0) complete tengine[6639]: 2007/09/19_15:40:34 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:34 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2240, rc=0) complete tengine[6639]: 2007/09/19_15:40:34 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:34 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2243, rc=0) complete tengine[6639]: 2007/09/19_15:40:34 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:33 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + lrmd[12120]: 2007/09/19_15:40:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2245, rc=0) complete tengine[6639]: 2007/09/19_15:40:34 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 WARN: process_pe_message: Transition 55: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-73.bz2 cibmon[15210]: 2007/09/19_15:40:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:33 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:25 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:40:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3294 cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3295 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:34 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2246, rc=254) Error cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:34 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:34 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:34 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:34 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3295 cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3296 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3296 cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3297 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3297 cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3298 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2247, rc=7) complete tengine[6639]: 2007/09/19_15:40:35 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:35 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:35 notice: run_graph: Transition 55: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:35 info: unpack_graph: Unpacked transition 56: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3298 crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3299 crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:56:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2250, rc=0) complete tengine[6639]: 2007/09/19_15:40:35 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:35 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:35 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 40 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:40:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2249, rc=0) complete tengine[6639]: 2007/09/19_15:40:35 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2248, rc=0) complete tengine[6639]: 2007/09/19_15:40:35 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2251, rc=0) complete tengine[6639]: 2007/09/19_15:40:35 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:35 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:35 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3299 pengine[6640]: 2007/09/19_15:40:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3300 pengine[6640]: 2007/09/19_15:40:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 WARN: process_pe_message: Transition 56: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-74.bz2 cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:35 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - lrmd[12205]: 2007/09/19_15:40:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:35 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3302 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3303 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3303 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3304 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3304 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3305 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3305 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3306 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3306 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3307 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3307 cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3308 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2252, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2253, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2254, rc=254) Error tengine[6639]: 2007/09/19_15:40:36 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2255, rc=7) complete tengine[6639]: 2007/09/19_15:40:36 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:36 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:36 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 notice: run_graph: Transition 56: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:36 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: unpack_graph: Unpacked transition 57: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:36 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:36 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:57:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:36 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2258, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:36 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2257, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2256, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2259, rc=0) complete tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3308 pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3309 pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:36 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + lrmd[12304]: 2007/09/19_15:40:37 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:37 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2262, rc=254) Error tengine[6639]: 2007/09/19_15:40:36 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:36 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2260, rc=0) complete tengine[6639]: 2007/09/19_15:40:37 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:36 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2263, rc=7) complete tengine[6639]: 2007/09/19_15:40:37 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:36 WARN: process_pe_message: Transition 57: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-75.bz2 cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2261, rc=0) complete tengine[6639]: 2007/09/19_15:40:37 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:36 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:37 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:37 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:37 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:37 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:37 notice: run_graph: Transition 57: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:37 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:26 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:37 info: unpack_graph: Unpacked transition 58: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:37 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:27 ERROR: cl_log: 30 messages were dropped tengine[6639]: 2007/09/19_15:40:37 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:37 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_cib_diff: cib_update: Diff: --- 0.2.3310 tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.3311 tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - lrmd[12408]: 2007/09/19_15:40:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:58:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:37 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2265, rc=0) complete tengine[6639]: 2007/09/19_15:40:38 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2266, rc=0) complete tengine[6639]: 2007/09/19_15:40:38 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2264, rc=0) complete tengine[6639]: 2007/09/19_15:40:38 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:38 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2267, rc=0) complete tengine[6639]: 2007/09/19_15:40:38 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:37 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:37 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:28 ERROR: cl_log: 204 messages were dropped pengine[6640]: 2007/09/19_15:40:37 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:37 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:28 info: log_cib_diff: cib_update: Diff: --- 0.2.3318 pengine[6640]: 2007/09/19_15:40:37 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.3319 pengine[6640]: 2007/09/19_15:40:37 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:37 WARN: process_pe_message: Transition 58: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-76.bz2 cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:37 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3319 cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3320 cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3320 cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3321 cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2268, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2270, rc=254) Error tengine[6639]: 2007/09/19_15:40:39 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2269, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2271, rc=7) complete tengine[6639]: 2007/09/19_15:40:39 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:39 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 notice: run_graph: Transition 58: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:39 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: unpack_graph: Unpacked transition 59: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:39 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:39 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:40:39 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + lrmd[12465]: 2007/09/19_15:40:39 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:59:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2272, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2278, rc=254) Error tengine[6639]: 2007/09/19_15:40:39 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2274, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:39 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2273, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2279, rc=7) complete tengine[6639]: 2007/09/19_15:40:39 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:39 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:39 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2275, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:39 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 ERROR: cl_log: 30 messages were dropped tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3322 tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3323 tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2276, rc=0) complete tengine[6639]: 2007/09/19_15:40:39 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 WARN: process_pe_message: Transition 59: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-77.bz2 cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:39 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3323 cibmon[15210]: 2007/09/19_15:40:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3324 cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:40 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3326 cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3327 cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3327 cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3328 cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:40 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2277, rc=0) complete tengine[6639]: 2007/09/19_15:40:40 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:40 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:40 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:40 notice: run_graph: Transition 59: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:40 info: unpack_graph: Unpacked transition 60: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:40 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:40 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3328 pengine[6640]: 2007/09/19_15:40:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3329 pengine[6640]: 2007/09/19_15:40:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:40 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:40 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + lrmd[12600]: 2007/09/19_15:40:41 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:60:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2282, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2280, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:40 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2286, rc=254) Error tengine[6639]: 2007/09/19_15:40:41 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:40 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2285, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:40 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2287, rc=7) complete tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2281, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 WARN: process_pe_message: Transition 60: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-78.bz2 cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:41 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2283, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:40 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2284, rc=0) complete tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3329 tengine[6639]: 2007/09/19_15:40:41 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3330 cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:42 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:40:31 info: log_cib_diff: cib_update: Diff: --- 0.2.3330 crmd[15216]: 2007/09/19_15:40:42 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:42 notice: run_graph: Transition 60: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:40:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3331 cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:40:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3335 cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3336 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:42 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + lrmd[12727]: 2007/09/19_15:40:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:42 info: unpack_graph: Unpacked transition 61: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:42 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:42 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3336 crmd[15216]: 2007/09/19_15:40:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:61:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3337 crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2290, rc=0) complete tengine[6639]: 2007/09/19_15:40:42 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2292, rc=0) complete tengine[6639]: 2007/09/19_15:40:42 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:42 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2288, rc=0) complete tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2289, rc=0) complete tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:42 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2291, rc=0) complete tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2294, rc=254) Error tengine[6639]: 2007/09/19_15:40:42 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2293, rc=0) complete tengine[6639]: 2007/09/19_15:40:43 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:42 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2295, rc=7) complete tengine[6639]: 2007/09/19_15:40:43 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:42 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:43 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:42 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 WARN: process_pe_message: Transition 61: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-79.bz2 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:42 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 notice: run_graph: Transition 61: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: unpack_graph: Unpacked transition 62: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + lrmd[12825]: 2007/09/19_15:40:44 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:62:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2298, rc=0) complete tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2296, rc=0) complete tengine[6639]: 2007/09/19_15:40:43 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2297, rc=0) complete tengine[6639]: 2007/09/19_15:40:43 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2299, rc=0) complete tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3337 tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3338 tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:43 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 WARN: process_pe_message: Transition 62: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-80.bz2 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:43 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3338 cibmon[15210]: 2007/09/19_15:40:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3339 cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:40:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3342 cibmon[15210]: 2007/09/19_15:40:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3343 cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:40:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3346 cibmon[15210]: 2007/09/19_15:40:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3347 cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2300, rc=0) complete tengine[6639]: 2007/09/19_15:40:44 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2301, rc=0) complete tengine[6639]: 2007/09/19_15:40:44 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2302, rc=254) Error tengine[6639]: 2007/09/19_15:40:44 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2303, rc=7) complete tengine[6639]: 2007/09/19_15:40:44 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:44 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:44 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:44 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:44 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 ERROR: cl_log: 117 messages were dropped crmd[15216]: 2007/09/19_15:40:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 notice: run_graph: Transition 62: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:44 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: unpack_graph: Unpacked transition 63: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:44 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3351 crmd[15216]: 2007/09/19_15:40:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:44 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3352 crmd[15216]: 2007/09/19_15:40:45 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:46 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 280 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:40:45 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:46 info: G_SIG_dispatch: started at 430122018 should have started at 430121990 crmd[15216]: 2007/09/19_15:40:45 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:63:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:44 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2306, rc=0) complete tengine[6639]: 2007/09/19_15:40:44 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:44 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2305, rc=0) complete tengine[6639]: 2007/09/19_15:40:45 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2308, rc=0) complete tengine[6639]: 2007/09/19_15:40:45 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2304, rc=0) complete tengine[6639]: 2007/09/19_15:40:45 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:45 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2307, rc=0) complete tengine[6639]: 2007/09/19_15:40:45 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2309, rc=0) complete tengine[6639]: 2007/09/19_15:40:45 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:44 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:34 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:40:44 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:44 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3352 pengine[6640]: 2007/09/19_15:40:44 WARN: process_pe_message: Transition 63: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-81.bz2 cibmon[15210]: 2007/09/19_15:40:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3353 pengine[6640]: 2007/09/19_15:40:44 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - lrmd[12940]: 2007/09/19_15:40:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3353 cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3354 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2310, rc=254) Error cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3354 cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3355 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:46 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:46 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:46 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3355 cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3356 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2311, rc=7) complete cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3357 cibmon[15210]: 2007/09/19_15:40:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3358 cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:46 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:40:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:46 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:46 notice: run_graph: Transition 63: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: unpack_graph: Unpacked transition 64: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:64:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2313, rc=0) complete tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2314, rc=0) complete tengine[6639]: 2007/09/19_15:40:46 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2312, rc=0) complete tengine[6639]: 2007/09/19_15:40:46 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:46 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2315, rc=0) complete tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2317, rc=0) complete tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 ERROR: cl_log: 1 messages were dropped tengine[6639]: 2007/09/19_15:40:46 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:46 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:46 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3358 pengine[6640]: 2007/09/19_15:40:46 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3359 pengine[6640]: 2007/09/19_15:40:46 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 WARN: process_pe_message: Transition 64: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-82.bz2 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:46 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3359 cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3360 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + lrmd[13074]: 2007/09/19_15:40:47 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2318, rc=254) Error tengine[6639]: 2007/09/19_15:40:47 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + lrmd[13170]: 2007/09/19_15:40:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2316, rc=0) complete tengine[6639]: 2007/09/19_15:40:47 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2319, rc=7) complete tengine[6639]: 2007/09/19_15:40:47 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:47 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 notice: run_graph: Transition 64: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:47 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: unpack_graph: Unpacked transition 65: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:47 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:47 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3360 crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3361 crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:47 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:65:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2322, rc=0) complete tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2321, rc=0) complete tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2320, rc=0) complete tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:47 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2323, rc=0) complete tengine[6639]: 2007/09/19_15:40:47 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:47 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:47 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:47 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:47 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:47 WARN: process_pe_message: Transition 65: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-83.bz2 cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3361 pengine[6640]: 2007/09/19_15:40:47 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3362 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3362 cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3363 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3363 cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3364 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3364 cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3365 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2324, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2326, rc=254) Error tengine[6639]: 2007/09/19_15:40:48 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2325, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2327, rc=7) complete tengine[6639]: 2007/09/19_15:40:48 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:48 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:48 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:48 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:48 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:48 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 notice: run_graph: Transition 65: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:48 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: unpack_graph: Unpacked transition 66: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:48 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:48 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:40:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:66:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2330, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3365 crmd[15216]: 2007/09/19_15:40:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2329, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3366 crmd[15216]: 2007/09/19_15:40:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2328, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2331, rc=0) complete tengine[6639]: 2007/09/19_15:40:48 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:48 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:48 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:49 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:49 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:49 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - lrmd[13273]: 2007/09/19_15:40:50 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:40:49 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:48 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 WARN: process_pe_message: Transition 66: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-84.bz2 cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:48 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 ERROR: cl_log: 233 messages were dropped cibmon[15210]: 2007/09/19_15:40:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3374 cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3375 cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3375 cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3376 cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3376 cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3377 cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2332, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2334, rc=254) Error tengine[6639]: 2007/09/19_15:40:50 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2335, rc=7) complete tengine[6639]: 2007/09/19_15:40:50 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2333, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:50 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 notice: run_graph: Transition 66: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:50 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: unpack_graph: Unpacked transition 67: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:50 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:50 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 ERROR: cl_log: 30 messages were dropped tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3378 tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3379 tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:67:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:50 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:50 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2337, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2338, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2336, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:50 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2339, rc=0) complete tengine[6639]: 2007/09/19_15:40:50 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2341, rc=0) complete pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 WARN: process_pe_message: Transition 67: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-85.bz2 cibmon[15210]: 2007/09/19_15:40:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:40 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:40:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3384 cibmon[15210]: 2007/09/19_15:40:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3385 cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:51 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3385 cibmon[15210]: 2007/09/19_15:40:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3386 cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3386 cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3387 cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - lrmd[13395]: 2007/09/19_15:40:51 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:51 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2342, rc=254) Error tengine[6639]: 2007/09/19_15:40:51 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2340, rc=0) complete tengine[6639]: 2007/09/19_15:40:51 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2343, rc=7) complete tengine[6639]: 2007/09/19_15:40:51 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:51 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:51 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:51 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:51 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:51 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:51 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:51 notice: run_graph: Transition 67: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:51 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3387 pengine[6640]: 2007/09/19_15:40:51 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3388 pengine[6640]: 2007/09/19_15:40:51 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:51 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[6640]: 2007/09/19_15:40:51 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:40:51 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: unpack_graph: Unpacked transition 68: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:51 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:68:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2346, rc=0) complete tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2345, rc=0) complete tengine[6639]: 2007/09/19_15:40:51 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2344, rc=0) complete tengine[6639]: 2007/09/19_15:40:51 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:52 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2347, rc=0) complete tengine[6639]: 2007/09/19_15:40:51 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2349, rc=0) complete tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2348, rc=0) complete tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + lrmd[13538]: 2007/09/19_15:40:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2350, rc=254) Error tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:51 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2351, rc=7) complete tengine[6639]: 2007/09/19_15:40:52 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:51 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:52 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:51 WARN: process_pe_message: Transition 68: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-86.bz2 cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:52 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:51 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:52 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 notice: run_graph: Transition 68: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3388 crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: unpack_graph: Unpacked transition 69: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3389 crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:53 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - lrmd[13625]: 2007/09/19_15:40:54 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:69:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2354, rc=0) complete tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2353, rc=0) complete tengine[6639]: 2007/09/19_15:40:53 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2352, rc=0) complete tengine[6639]: 2007/09/19_15:40:53 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2355, rc=0) complete tengine[6639]: 2007/09/19_15:40:53 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:53 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:53 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:42 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3393 pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3394 pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 WARN: process_pe_message: Transition 69: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-87.bz2 cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:53 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3394 cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3395 cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3395 cibmon[15210]: 2007/09/19_15:40:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3396 cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2358, rc=254) Error cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:40:54 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 60 ms (> 30 ms) (GSource: 0x8877298) cibmon[15210]: 2007/09/19_15:40:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:43 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:40:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3402 crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2356, rc=0) complete cibmon[15210]: 2007/09/19_15:40:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3403 cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2359, rc=7) complete tengine[6639]: 2007/09/19_15:40:54 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2357, rc=0) complete tengine[6639]: 2007/09/19_15:40:54 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:54 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:54 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 notice: run_graph: Transition 69: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:54 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: unpack_graph: Unpacked transition 70: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:54 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:54 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:54 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + lrmd[13724]: 2007/09/19_15:40:55 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:70:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:54 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2362, rc=0) complete tengine[6639]: 2007/09/19_15:40:54 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:54 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2360, rc=0) complete tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2361, rc=0) complete tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:54 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2363, rc=0) complete tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:54 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:43 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 ERROR: cl_log: 88 messages were dropped pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3406 pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3407 pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 WARN: process_pe_message: Transition 70: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-88.bz2 cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:54 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3407 cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3408 cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3408 cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3409 cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3409 cibmon[15210]: 2007/09/19_15:40:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3410 cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3415 cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3416 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2366, rc=254) Error tengine[6639]: 2007/09/19_15:40:55 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2364, rc=0) complete tengine[6639]: 2007/09/19_15:40:55 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2365, rc=0) complete tengine[6639]: 2007/09/19_15:40:55 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2367, rc=7) complete tengine[6639]: 2007/09/19_15:40:55 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:55 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:55 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:55 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 notice: run_graph: Transition 70: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:55 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: unpack_graph: Unpacked transition 71: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:55 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:56 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:55 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:56 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:71:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2369, rc=0) complete tengine[6639]: 2007/09/19_15:40:55 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2370, rc=0) complete tengine[6639]: 2007/09/19_15:40:55 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:55 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2368, rc=0) complete tengine[6639]: 2007/09/19_15:40:56 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2371, rc=0) complete tengine[6639]: 2007/09/19_15:40:56 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:56 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2373, rc=0) complete tengine[6639]: 2007/09/19_15:40:56 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:40:56 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3416 pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3417 pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:56 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:55 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:55 WARN: process_pe_message: Transition 71: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-89.bz2 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:55 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3417 cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3418 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3418 cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3419 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - lrmd[13848]: 2007/09/19_15:40:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2374, rc=254) Error tengine[6639]: 2007/09/19_15:40:57 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:57 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - lrmd[13904]: 2007/09/19_15:40:57 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2372, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2375, rc=7) complete tengine[6639]: 2007/09/19_15:40:57 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:57 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 notice: run_graph: Transition 71: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:57 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: unpack_graph: Unpacked transition 72: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:57 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:57 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:72:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2378, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2377, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2382, rc=254) Error tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2380, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2383, rc=7) complete tengine[6639]: 2007/09/19_15:40:57 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:57 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2376, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:57 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2379, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:40:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2381, rc=0) complete tengine[6639]: 2007/09/19_15:40:57 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:40:57 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:40:57 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3419 tengine[6639]: 2007/09/19_15:40:57 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3420 tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:57 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:58 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:57 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:58 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:58 notice: run_graph: Transition 72: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:57 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:57 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:57 WARN: process_pe_message: Transition 72: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-90.bz2 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:57 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:46 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3420 cibmon[15210]: 2007/09/19_15:40:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3421 cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:46 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:40:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:58 info: unpack_graph: Unpacked transition 73: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:40:58 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:40:58 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3422 crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3423 crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:73:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2386, rc=0) complete tengine[6639]: 2007/09/19_15:40:58 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2385, rc=0) complete tengine[6639]: 2007/09/19_15:40:58 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2384, rc=0) complete tengine[6639]: 2007/09/19_15:40:58 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2387, rc=0) complete tengine[6639]: 2007/09/19_15:40:58 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:40:58 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 WARN: process_pe_message: Transition 73: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-91.bz2 cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:40:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3423 cibmon[15210]: 2007/09/19_15:40:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3424 tengine[6639]: 2007/09/19_15:40:58 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - lrmd[14025]: 2007/09/19_15:40:59 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 ERROR: cl_log: 175 messages were dropped cibmon[15210]: 2007/09/19_15:40:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3430 cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3431 cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3431 cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3432 cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3432 cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3433 cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3433 cibmon[15210]: 2007/09/19_15:40:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3434 cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3435 cibmon[15210]: 2007/09/19_15:40:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3436 cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:40:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3438 crmd[15216]: 2007/09/19_15:40:59 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2390, rc=254) Error tengine[6639]: 2007/09/19_15:40:59 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3439 crmd[15216]: 2007/09/19_15:40:59 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2388, rc=0) complete tengine[6639]: 2007/09/19_15:40:59 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2389, rc=0) complete tengine[6639]: 2007/09/19_15:40:59 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:40:59 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2391, rc=7) complete tengine[6639]: 2007/09/19_15:40:59 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:40:59 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:40:59 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:00 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:00 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:00 notice: run_graph: Transition 73: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:00 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:00 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 50 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:41:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:00 info: unpack_graph: Unpacked transition 74: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3439 crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3440 crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:74:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2394, rc=0) complete tengine[6639]: 2007/09/19_15:41:00 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2392, rc=0) complete tengine[6639]: 2007/09/19_15:41:00 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2393, rc=0) complete tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2396, rc=0) complete tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:00 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2395, rc=0) complete tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - lrmd[14144]: 2007/09/19_15:41:01 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:00 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:00 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 WARN: process_pe_message: Transition 74: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-92.bz2 cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:00 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3440 cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3441 cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3442 cibmon[15210]: 2007/09/19_15:40:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3443 cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:40:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3446 cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3447 cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2397, rc=0) complete cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3447 cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3448 cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:01 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2398, rc=254) Error tengine[6639]: 2007/09/19_15:41:01 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3448 crmd[15216]: 2007/09/19_15:41:01 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2399, rc=7) complete tengine[6639]: 2007/09/19_15:41:01 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3449 crmd[15216]: 2007/09/19_15:41:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:01 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:01 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:01 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:01 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 notice: run_graph: Transition 74: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:01 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: unpack_graph: Unpacked transition 75: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:01 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:01 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:01 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + lrmd[14275]: 2007/09/19_15:41:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:01 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:75:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:01 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:01 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2402, rc=0) complete tengine[6639]: 2007/09/19_15:41:02 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2401, rc=0) complete tengine[6639]: 2007/09/19_15:41:02 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:02 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2400, rc=0) complete tengine[6639]: 2007/09/19_15:41:02 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:02 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2403, rc=0) complete tengine[6639]: 2007/09/19_15:41:02 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:01 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3450 pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3451 pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:01 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:01 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:41:03 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 60 ms (> 30 ms) (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:41:03 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2406, rc=254) Error tengine[6639]: 2007/09/19_15:41:03 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:01 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2404, rc=0) complete tengine[6639]: 2007/09/19_15:41:03 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:01 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2405, rc=0) complete tengine[6639]: 2007/09/19_15:41:03 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:01 WARN: process_pe_message: Transition 75: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-93.bz2 cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2407, rc=7) complete tengine[6639]: 2007/09/19_15:41:03 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:01 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:03 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:03 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:03 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:03 notice: run_graph: Transition 75: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:52 ERROR: cl_log: 146 messages were dropped cibmon[15210]: 2007/09/19_15:40:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:52 info: log_cib_diff: cib_update: Diff: --- 0.2.3456 cibmon[15210]: 2007/09/19_15:40:52 info: log_cib_diff: cib_update: Diff: +++ 0.2.3457 cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:03 info: unpack_graph: Unpacked transition 76: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:03 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:03 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:76:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:03 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2410, rc=0) complete tengine[6639]: 2007/09/19_15:41:03 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:03 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2409, rc=0) complete tengine[6639]: 2007/09/19_15:41:03 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:03 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:04 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:03 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:03 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:03 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:03 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + lrmd[14377]: 2007/09/19_15:41:04 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:04 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2408, rc=0) complete tengine[6639]: 2007/09/19_15:41:04 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:52 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2413, rc=0) complete tengine[6639]: 2007/09/19_15:41:04 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 ERROR: cl_log: 146 messages were dropped pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3462 pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3463 pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:03 WARN: process_pe_message: Transition 76: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-94.bz2 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:03 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3463 cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3464 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3464 cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3465 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:04 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2414, rc=254) Error tengine[6639]: 2007/09/19_15:41:04 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2412, rc=0) complete tengine[6639]: 2007/09/19_15:41:04 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2415, rc=7) complete tengine[6639]: 2007/09/19_15:41:04 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:04 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:04 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3465 cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3466 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:54 ERROR: cl_log: 1 messages were dropped tengine[6639]: 2007/09/19_15:41:05 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3466 cibmon[15210]: 2007/09/19_15:40:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3467 cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2411, rc=0) complete tengine[6639]: 2007/09/19_15:41:05 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:05 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:05 notice: run_graph: Transition 76: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:05 info: unpack_graph: Unpacked transition 77: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:05 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:54 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 ERROR: cl_log: 88 messages were dropped tengine[6639]: 2007/09/19_15:41:05 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:05 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3470 pengine[6640]: 2007/09/19_15:41:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3471 pengine[6640]: 2007/09/19_15:41:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:05 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:05 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:05 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:05 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:05 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:77:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2417, rc=0) complete pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2418, rc=0) complete pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2416, rc=0) complete pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:06 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:05 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 WARN: process_pe_message: Transition 77: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-95.bz2 cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:05 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3471 cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3472 cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - lrmd[14489]: 2007/09/19_15:41:06 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:06 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2419, rc=0) complete tengine[6639]: 2007/09/19_15:41:06 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3472 cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3473 cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3473 cibmon[15210]: 2007/09/19_15:40:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3474 cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3474 cibmon[15210]: 2007/09/19_15:40:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3475 cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2420, rc=0) complete cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:40:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3479 cibmon[15210]: 2007/09/19_15:40:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3480 cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:06 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:06 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2422, rc=254) Error tengine[6639]: 2007/09/19_15:41:06 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2423, rc=7) complete tengine[6639]: 2007/09/19_15:41:06 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2421, rc=0) complete tengine[6639]: 2007/09/19_15:41:06 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:06 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3480 crmd[15216]: 2007/09/19_15:41:07 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3481 crmd[15216]: 2007/09/19_15:41:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:07 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 notice: run_graph: Transition 77: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:07 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: unpack_graph: Unpacked transition 78: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:07 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:07 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:78:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2426, rc=0) complete tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - lrmd[14585]: 2007/09/19_15:41:08 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2425, rc=0) complete tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2428, rc=0) complete tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2424, rc=0) complete tengine[6639]: 2007/09/19_15:41:07 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2427, rc=0) complete tengine[6639]: 2007/09/19_15:41:07 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:07 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:07 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:07 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:58 ERROR: cl_log: 233 messages were dropped pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3489 pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3490 pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:07 WARN: process_pe_message: Transition 78: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-96.bz2 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2430, rc=254) Error pengine[6640]: 2007/09/19_15:41:07 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:40:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3490 cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3491 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2429, rc=0) complete tengine[6639]: 2007/09/19_15:41:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2431, rc=7) complete cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3491 cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3492 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 notice: run_graph: Transition 78: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:08 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:58 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:40:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3493 cibmon[15210]: 2007/09/19_15:40:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3494 cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:08 info: unpack_graph: Unpacked transition 79: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:09 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:09 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:09 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:09 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:79:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:09 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2433, rc=0) complete tengine[6639]: 2007/09/19_15:41:08 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:08 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:08 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:09 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:59 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:41:08 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:40:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:08 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3494 crmd[15216]: 2007/09/19_15:41:09 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2434, rc=0) complete tengine[6639]: 2007/09/19_15:41:09 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:08 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3495 crmd[15216]: 2007/09/19_15:41:09 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2432, rc=0) complete pengine[6640]: 2007/09/19_15:41:08 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 WARN: process_pe_message: Transition 79: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-97.bz2 cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:08 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:09 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3495 cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3496 lrmd[14675]: 2007/09/19_15:41:10 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:09 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2437, rc=0) complete tengine[6639]: 2007/09/19_15:41:09 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3496 cibmon[15210]: 2007/09/19_15:40:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3497 cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:40:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3497 cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3498 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2438, rc=254) Error tengine[6639]: 2007/09/19_15:41:10 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2436, rc=0) complete tengine[6639]: 2007/09/19_15:41:10 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:10 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:10 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3498 cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3499 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3499 cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3500 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:10 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2439, rc=7) complete tengine[6639]: 2007/09/19_15:41:10 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2435, rc=0) complete cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3500 cibmon[15210]: 2007/09/19_15:41:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3501 cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:10 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:10 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:10 notice: run_graph: Transition 79: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: unpack_graph: Unpacked transition 80: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 ERROR: cl_log: 59 messages were dropped crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3503 crmd[15216]: 2007/09/19_15:41:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:80:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3504 crmd[15216]: 2007/09/19_15:41:11 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2442, rc=0) complete tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:10 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:11 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2441, rc=0) complete tengine[6639]: 2007/09/19_15:41:10 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:11 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2440, rc=0) complete tengine[6639]: 2007/09/19_15:41:11 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:11 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2443, rc=0) complete tengine[6639]: 2007/09/19_15:41:11 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:11 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:10 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:10 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3504 pengine[6640]: 2007/09/19_15:41:10 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3505 tengine[6639]: 2007/09/19_15:41:11 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:10 WARN: process_pe_message: Transition 80: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-98.bz2 cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:10 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - lrmd[14793]: 2007/09/19_15:41:12 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3505 cibmon[15210]: 2007/09/19_15:41:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3506 cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3506 cibmon[15210]: 2007/09/19_15:41:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3507 cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:12 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2446, rc=254) Error cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3507 cibmon[15210]: 2007/09/19_15:41:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3508 cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:41:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2444, rc=0) complete tengine[6639]: 2007/09/19_15:41:12 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3510 crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2445, rc=0) complete tengine[6639]: 2007/09/19_15:41:12 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3511 crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2447, rc=7) complete tengine[6639]: 2007/09/19_15:41:12 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:12 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 notice: run_graph: Transition 80: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:12 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: unpack_graph: Unpacked transition 81: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:12 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:12 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:81:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2450, rc=0) complete cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - lrmd[14886]: 2007/09/19_15:41:13 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2449, rc=0) complete tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2448, rc=0) complete tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:13 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2451, rc=0) complete tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:12 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:12 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:13 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 ERROR: cl_log: 88 messages were dropped pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3514 pengine[6640]: 2007/09/19_15:41:12 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3515 pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 WARN: process_pe_message: Transition 81: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-99.bz2 cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:12 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3515 cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3516 cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2452, rc=0) complete tengine[6639]: 2007/09/19_15:41:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 ERROR: cl_log: 59 messages were dropped crmd[15216]: 2007/09/19_15:41:13 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2454, rc=254) Error tengine[6639]: 2007/09/19_15:41:13 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2453, rc=0) complete tengine[6639]: 2007/09/19_15:41:13 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3518 crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2455, rc=7) complete tengine[6639]: 2007/09/19_15:41:13 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3519 tengine[6639]: 2007/09/19_15:41:13 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3519 cibmon[15210]: 2007/09/19_15:41:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3520 cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:14 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:14 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:14 notice: run_graph: Transition 81: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:14 info: unpack_graph: Unpacked transition 82: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:14 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:14 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:14 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:82:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:14 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2458, rc=0) complete tengine[6639]: 2007/09/19_15:41:14 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2456, rc=0) complete tengine[6639]: 2007/09/19_15:41:14 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2457, rc=0) complete pengine[6640]: 2007/09/19_15:41:14 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:14 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3520 pengine[6640]: 2007/09/19_15:41:14 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3521 pengine[6640]: 2007/09/19_15:41:14 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - lrmd[14980]: 2007/09/19_15:41:15 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:14 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2459, rc=0) complete tengine[6639]: 2007/09/19_15:41:15 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 WARN: process_pe_message: Transition 82: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-100.bz2 cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:14 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3521 cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3522 cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3522 cibmon[15210]: 2007/09/19_15:41:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3523 cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3524 cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3525 cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:15 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2462, rc=254) Error tengine[6639]: 2007/09/19_15:41:15 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:15 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2460, rc=0) complete tengine[6639]: 2007/09/19_15:41:15 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:15 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2461, rc=0) complete tengine[6639]: 2007/09/19_15:41:15 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:15 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:15 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3526 cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3527 cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:15 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 40 ms (> 30 ms) (GSource: 0x8877298) tengine[6639]: 2007/09/19_15:41:15 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3527 cibmon[15210]: 2007/09/19_15:41:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3528 cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:16 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2463, rc=7) complete cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: --- 0.2.3528 cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.3529 cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:16 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:16 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:16 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:16 notice: run_graph: Transition 82: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: unpack_graph: Unpacked transition 83: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:83:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:16 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2466, rc=0) complete tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:16 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:16 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: --- 0.2.3529 cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.3530 crmd[15216]: 2007/09/19_15:41:16 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2465, rc=0) complete tengine[6639]: 2007/09/19_15:41:16 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:16 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2464, rc=0) complete tengine[6639]: 2007/09/19_15:41:16 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:16 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2467, rc=0) complete tengine[6639]: 2007/09/19_15:41:16 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:16 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:16 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 WARN: process_pe_message: Transition 83: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-101.bz2 cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:16 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: --- 0.2.3530 lrmd[15088]: 2007/09/19_15:41:17 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:17 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2470, rc=254) Error tengine[6639]: 2007/09/19_15:41:16 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.3531 crmd[15216]: 2007/09/19_15:41:17 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2468, rc=0) complete tengine[6639]: 2007/09/19_15:41:17 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2469, rc=0) complete tengine[6639]: 2007/09/19_15:41:17 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2471, rc=7) complete tengine[6639]: 2007/09/19_15:41:17 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:17 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:17 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:17 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 ERROR: cl_log: 117 messages were dropped cibmon[15210]: 2007/09/19_15:41:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:17 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: --- 0.2.3535 tengine[6639]: 2007/09/19_15:41:17 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.3536 tengine[6639]: 2007/09/19_15:41:17 notice: run_graph: Transition 83: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:17 info: unpack_graph: Unpacked transition 84: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:84:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2474, rc=0) complete tengine[6639]: 2007/09/19_15:41:17 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2473, rc=0) complete tengine[6639]: 2007/09/19_15:41:17 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:17 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:18 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2472, rc=0) complete tengine[6639]: 2007/09/19_15:41:17 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2475, rc=0) complete tengine[6639]: 2007/09/19_15:41:18 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:18 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:08 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:41:17 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:17 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: --- 0.2.3536 pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.3537 pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:18 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - lrmd[15182]: 2007/09/19_15:41:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:17 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 WARN: process_pe_message: Transition 84: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-102.bz2 cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:17 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2478, rc=254) Error tengine[6639]: 2007/09/19_15:41:18 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:18 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: --- 0.2.3537 tengine[6639]: 2007/09/19_15:41:18 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.3538 tengine[6639]: 2007/09/19_15:41:18 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3538 cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3539 cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2476, rc=0) complete tengine[6639]: 2007/09/19_15:41:19 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2477, rc=0) complete tengine[6639]: 2007/09/19_15:41:19 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3539 cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3540 cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3540 cibmon[15210]: 2007/09/19_15:41:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3541 cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2479, rc=7) complete tengine[6639]: 2007/09/19_15:41:19 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:19 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:19 notice: run_graph: Transition 84: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:19 info: unpack_graph: Unpacked transition 85: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:19 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:19 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:10 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:19 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:19 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3542 crmd[15216]: 2007/09/19_15:41:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:85:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3543 crmd[15216]: 2007/09/19_15:41:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2482, rc=0) complete pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2480, rc=0) complete pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2481, rc=0) complete pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:19 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 WARN: process_pe_message: Transition 85: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-103.bz2 cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:20 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + lrmd[15290]: 2007/09/19_15:41:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2483, rc=0) complete tengine[6639]: 2007/09/19_15:41:20 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3543 cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3544 cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3544 cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3545 cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3545 cibmon[15210]: 2007/09/19_15:41:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3546 cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3546 cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3547 cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2486, rc=254) Error tengine[6639]: 2007/09/19_15:41:20 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2484, rc=0) complete tengine[6639]: 2007/09/19_15:41:20 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2485, rc=0) complete tengine[6639]: 2007/09/19_15:41:20 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:20 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3547 cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3548 cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:11 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3549 cibmon[15210]: 2007/09/19_15:41:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3550 cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2487, rc=7) complete tengine[6639]: 2007/09/19_15:41:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:21 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:21 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:21 notice: run_graph: Transition 85: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:21 info: unpack_graph: Unpacked transition 86: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:21 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:21 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:21 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 ERROR: cl_log: 1 messages were dropped tengine[6639]: 2007/09/19_15:41:21 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3550 pengine[6640]: 2007/09/19_15:41:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3551 pengine[6640]: 2007/09/19_15:41:21 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:21 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:21 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:21 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:86:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2490, rc=0) complete pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 WARN: process_pe_message: Transition 86: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-104.bz2 cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3551 cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3552 tengine[6639]: 2007/09/19_15:41:21 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - lrmd[15383]: 2007/09/19_15:41:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2489, rc=0) complete tengine[6639]: 2007/09/19_15:41:21 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2488, rc=0) complete tengine[6639]: 2007/09/19_15:41:21 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2493, rc=0) complete tengine[6639]: 2007/09/19_15:41:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2494, rc=254) Error tengine[6639]: 2007/09/19_15:41:22 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3552 tengine[6639]: 2007/09/19_15:41:22 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3553 tengine[6639]: 2007/09/19_15:41:22 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:22 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2492, rc=0) complete tengine[6639]: 2007/09/19_15:41:22 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2495, rc=7) complete tengine[6639]: 2007/09/19_15:41:22 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2491, rc=0) complete tengine[6639]: 2007/09/19_15:41:23 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:23 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:23 notice: run_graph: Transition 86: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:23 info: unpack_graph: Unpacked transition 87: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:23 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:23 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3553 tengine[6639]: 2007/09/19_15:41:23 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3554 tengine[6639]: 2007/09/19_15:41:23 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:23 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:87:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:23 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2498, rc=0) complete pengine[6640]: 2007/09/19_15:41:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2497, rc=0) complete pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2496, rc=0) complete pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2499, rc=0) complete pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:23 WARN: process_pe_message: Transition 87: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-105.bz2 cibmon[15210]: 2007/09/19_15:41:13 ERROR: cl_log: 117 messages were dropped lrmd[15499]: 2007/09/19_15:41:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:23 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:23 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3558 cibmon[15210]: 2007/09/19_15:41:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3559 cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3559 cibmon[15210]: 2007/09/19_15:41:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3560 cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3560 cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3561 cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2502, rc=254) Error tengine[6639]: 2007/09/19_15:41:24 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2500, rc=0) complete tengine[6639]: 2007/09/19_15:41:24 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2503, rc=7) complete tengine[6639]: 2007/09/19_15:41:24 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:24 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:24 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3561 cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3562 cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2501, rc=0) complete cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:24 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:14 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3562 cibmon[15210]: 2007/09/19_15:41:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3563 cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:24 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:24 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:24 notice: run_graph: Transition 87: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: unpack_graph: Unpacked transition 88: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:24 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:88:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2506, rc=0) complete tengine[6639]: 2007/09/19_15:41:24 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2505, rc=0) complete tengine[6639]: 2007/09/19_15:41:24 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2504, rc=0) complete tengine[6639]: 2007/09/19_15:41:25 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2507, rc=0) complete tengine[6639]: 2007/09/19_15:41:25 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:25 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:14 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:15 ERROR: cl_log: 88 messages were dropped pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3566 pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3567 pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:25 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:24 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:24 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 WARN: process_pe_message: Transition 88: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-106.bz2 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:24 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + lrmd[15593]: 2007/09/19_15:41:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3567 cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3568 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3568 cibmon[15210]: 2007/09/19_15:41:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3569 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2510, rc=254) Error tengine[6639]: 2007/09/19_15:41:26 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2508, rc=0) complete tengine[6639]: 2007/09/19_15:41:26 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2509, rc=0) complete tengine[6639]: 2007/09/19_15:41:26 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3569 cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3570 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3570 cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3571 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2511, rc=7) complete cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:26 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:26 notice: run_graph: Transition 88: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: unpack_graph: Unpacked transition 89: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:26 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:26 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:89:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:26 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3571 crmd[15216]: 2007/09/19_15:41:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2513, rc=0) complete tengine[6639]: 2007/09/19_15:41:27 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:26 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3572 crmd[15216]: 2007/09/19_15:41:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2514, rc=0) complete pengine[6640]: 2007/09/19_15:41:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:27 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2512, rc=0) complete pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:27 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2515, rc=0) complete pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 WARN: process_pe_message: Transition 89: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-107.bz2 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:26 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + lrmd[15688]: 2007/09/19_15:41:27 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:27 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2518, rc=254) Error tengine[6639]: 2007/09/19_15:41:27 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2516, rc=0) complete tengine[6639]: 2007/09/19_15:41:27 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:28 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2517, rc=0) complete tengine[6639]: 2007/09/19_15:41:27 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:27 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:27 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:27 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3572 cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3573 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3573 cibmon[15210]: 2007/09/19_15:41:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3574 cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:17 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:41:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3577 cibmon[15210]: 2007/09/19_15:41:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3578 cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2519, rc=7) complete tengine[6639]: 2007/09/19_15:41:28 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:28 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:28 notice: run_graph: Transition 89: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:28 info: unpack_graph: Unpacked transition 90: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:28 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:28 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:28 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:28 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:90:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 ERROR: cl_log: 88 messages were dropped crmd[15216]: 2007/09/19_15:41:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2522, rc=0) complete pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2521, rc=0) complete pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_cib_diff: cib_update: Diff: --- 0.2.3581 crmd[15216]: 2007/09/19_15:41:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2520, rc=0) complete pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.3582 pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:28 WARN: process_pe_message: Transition 90: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-108.bz2 cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + lrmd[15796]: 2007/09/19_15:41:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2523, rc=0) complete tengine[6639]: 2007/09/19_15:41:28 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:29 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:18 info: log_cib_diff: cib_update: Diff: --- 0.2.3582 cibmon[15210]: 2007/09/19_15:41:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.3583 cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3583 cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3584 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3585 cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3586 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3586 cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3587 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2524, rc=0) complete tengine[6639]: 2007/09/19_15:41:29 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2526, rc=254) Error tengine[6639]: 2007/09/19_15:41:29 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2525, rc=0) complete tengine[6639]: 2007/09/19_15:41:29 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2527, rc=7) complete tengine[6639]: 2007/09/19_15:41:29 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:29 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:29 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3587 cibmon[15210]: 2007/09/19_15:41:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3588 cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:30 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:30 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:30 notice: run_graph: Transition 90: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3588 crmd[15216]: 2007/09/19_15:41:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:30 info: unpack_graph: Unpacked transition 91: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3589 tengine[6639]: 2007/09/19_15:41:30 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:30 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:30 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:91:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:30 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2530, rc=0) complete pengine[6640]: 2007/09/19_15:41:30 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:41:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2529, rc=0) complete pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3590 pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3591 pengine[6640]: 2007/09/19_15:41:30 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2528, rc=0) complete tengine[6639]: 2007/09/19_15:41:30 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:30 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:30 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 WARN: process_pe_message: Transition 91: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-109.bz2 cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:30 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3591 cibmon[15210]: 2007/09/19_15:41:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3592 cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + lrmd[15890]: 2007/09/19_15:41:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2531, rc=0) complete tengine[6639]: 2007/09/19_15:41:30 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3592 cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3593 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3593 cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3594 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3594 cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3595 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2534, rc=254) Error tengine[6639]: 2007/09/19_15:41:31 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2532, rc=0) complete tengine[6639]: 2007/09/19_15:41:31 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:31 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2533, rc=0) complete tengine[6639]: 2007/09/19_15:41:31 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:31 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3595 cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3596 cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3596 cibmon[15210]: 2007/09/19_15:41:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3597 tengine[6639]: 2007/09/19_15:41:31 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2535, rc=7) complete tengine[6639]: 2007/09/19_15:41:31 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:31 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:31 notice: run_graph: Transition 91: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:31 info: unpack_graph: Unpacked transition 92: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:92:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2538, rc=0) complete tengine[6639]: 2007/09/19_15:41:31 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2537, rc=0) complete tengine[6639]: 2007/09/19_15:41:31 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:32 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2536, rc=0) complete tengine[6639]: 2007/09/19_15:41:32 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + lrmd[15986]: 2007/09/19_15:41:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2539, rc=0) complete tengine[6639]: 2007/09/19_15:41:32 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:32 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:32 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:22 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:41:31 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:31 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3598 pengine[6640]: 2007/09/19_15:41:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3599 pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:31 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:31 WARN: process_pe_message: Transition 92: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-110.bz2 cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2542, rc=254) Error tengine[6639]: 2007/09/19_15:41:33 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:31 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2540, rc=0) complete tengine[6639]: 2007/09/19_15:41:33 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2541, rc=0) complete tengine[6639]: 2007/09/19_15:41:33 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2543, rc=7) complete tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:23 ERROR: cl_log: 88 messages were dropped crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:33 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:33 notice: run_graph: Transition 92: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:33 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3602 tengine[6639]: 2007/09/19_15:41:33 info: unpack_graph: Unpacked transition 93: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:33 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3603 tengine[6639]: 2007/09/19_15:41:33 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:33 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:41:33 info: perform_op:2783: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:33 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:93:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:33 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:33 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2544, rc=0) complete tengine[6639]: 2007/09/19_15:41:34 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:33 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2546, rc=0) complete pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:34 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2545, rc=0) complete pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:34 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2549, rc=0) complete pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + lrmd[16078]: 2007/09/19_15:41:34 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:34 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:23 ERROR: cl_log: 59 messages were dropped pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:33 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3605 pengine[6640]: 2007/09/19_15:41:33 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3606 pengine[6640]: 2007/09/19_15:41:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:33 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:33 WARN: process_pe_message: Transition 93: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-111.bz2 cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:33 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:23 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3606 cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3607 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3607 cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3608 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:34 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2548, rc=0) complete cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3608 cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3609 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:34 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2550, rc=254) Error tengine[6639]: 2007/09/19_15:41:35 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2551, rc=7) complete tengine[6639]: 2007/09/19_15:41:35 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2547, rc=0) complete tengine[6639]: 2007/09/19_15:41:35 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3609 cibmon[15210]: 2007/09/19_15:41:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3610 cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 notice: run_graph: Transition 93: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:35 info: unpack_graph: Unpacked transition 94: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:25 ERROR: cl_log: 88 messages were dropped crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:35 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:94:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3613 crmd[15216]: 2007/09/19_15:41:35 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2554, rc=0) complete tengine[6639]: 2007/09/19_15:41:35 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3614 tengine[6639]: 2007/09/19_15:41:35 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:35 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:35 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:35 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2553, rc=0) complete tengine[6639]: 2007/09/19_15:41:35 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:25 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2552, rc=0) complete tengine[6639]: 2007/09/19_15:41:36 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:26 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:41:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2555, rc=0) complete pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:35 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3614 pengine[6640]: 2007/09/19_15:41:35 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3615 pengine[6640]: 2007/09/19_15:41:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 WARN: process_pe_message: Transition 94: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-112.bz2 cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:35 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3615 cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3616 tengine[6639]: 2007/09/19_15:41:36 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - lrmd[16188]: 2007/09/19_15:41:36 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3616 cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3617 cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3617 cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3618 cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:26 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3618 cibmon[15210]: 2007/09/19_15:41:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3619 cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:36 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2556, rc=0) complete tengine[6639]: 2007/09/19_15:41:36 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:36 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2558, rc=254) Error tengine[6639]: 2007/09/19_15:41:36 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2557, rc=0) complete tengine[6639]: 2007/09/19_15:41:36 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2559, rc=7) complete tengine[6639]: 2007/09/19_15:41:36 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:36 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:37 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 notice: run_graph: Transition 94: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:37 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: unpack_graph: Unpacked transition 95: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:37 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:37 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:26 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:37 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:95:cdefb5a2-efb8-49af-83f0-5a7f0e624015) cibmon[15210]: 2007/09/19_15:41:27 ERROR: cl_log: 59 messages were dropped lrmd[16282]: 2007/09/19_15:41:38 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2562, rc=0) complete tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2560, rc=0) complete tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:27 info: log_cib_diff: cib_update: Diff: --- 0.2.3621 crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2561, rc=0) complete tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:27 info: log_cib_diff: cib_update: Diff: +++ 0.2.3622 crmd[15216]: 2007/09/19_15:41:37 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2563, rc=0) complete tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:37 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:37 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:37 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:38 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2566, rc=254) Error tengine[6639]: 2007/09/19_15:41:38 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:37 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:38 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2564, rc=0) complete tengine[6639]: 2007/09/19_15:41:38 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:37 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:38 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2565, rc=0) complete tengine[6639]: 2007/09/19_15:41:38 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:37 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:38 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 WARN: process_pe_message: Transition 95: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-113.bz2 cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:38 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:37 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:27 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:41:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: --- 0.2.3625 cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.3626 cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: --- 0.2.3626 cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.3627 tengine[6639]: 2007/09/19_15:41:38 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2567, rc=7) complete tengine[6639]: 2007/09/19_15:41:38 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:38 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:38 notice: run_graph: Transition 95: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:38 info: unpack_graph: Unpacked transition 96: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:38 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:38 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:39 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:38 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:38 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:39 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:38 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:39 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:38 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:39 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:96:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:38 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:39 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2570, rc=0) complete pengine[6640]: 2007/09/19_15:41:38 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: --- 0.2.3627 pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.3628 pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:39 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2569, rc=0) complete tengine[6639]: 2007/09/19_15:41:39 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:39 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2568, rc=0) complete tengine[6639]: 2007/09/19_15:41:39 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2573, rc=0) complete tengine[6639]: 2007/09/19_15:41:39 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 WARN: process_pe_message: Transition 96: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-114.bz2 cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:38 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:39 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: --- 0.2.3628 cibmon[15210]: 2007/09/19_15:41:28 info: log_cib_diff: cib_update: Diff: +++ 0.2.3629 cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:28 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3630 cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3631 cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - lrmd[16372]: 2007/09/19_15:41:40 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:40 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2574, rc=254) Error tengine[6639]: 2007/09/19_15:41:40 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:40 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:40 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:40 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3631 cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3632 cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: --- 0.2.3632 cibmon[15210]: 2007/09/19_15:41:29 info: log_cib_diff: cib_update: Diff: +++ 0.2.3633 cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:29 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:40 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2572, rc=0) complete cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3633 cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3634 cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:40 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3634 crmd[15216]: 2007/09/19_15:41:40 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2575, rc=7) complete tengine[6639]: 2007/09/19_15:41:40 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3635 crmd[15216]: 2007/09/19_15:41:40 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2571, rc=0) complete cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3635 cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3636 cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:40 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:40 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:40 notice: run_graph: Transition 96: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:40 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:40 info: unpack_graph: Unpacked transition 97: 19 actions in 19 synapses pengine[6640]: 2007/09/19_15:41:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:30 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:41:40 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:40 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: --- 0.2.3637 crmd[15216]: 2007/09/19_15:41:40 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:30 info: log_cib_diff: cib_update: Diff: +++ 0.2.3638 crmd[15216]: 2007/09/19_15:41:41 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:97:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2578, rc=0) complete tengine[6639]: 2007/09/19_15:41:40 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:40 info: te_pseudo_action: Pseudo action 35 fired and confirmed pengine[6640]: 2007/09/19_15:41:40 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:41 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:41 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2577, rc=0) complete tengine[6639]: 2007/09/19_15:41:41 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:40 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:41 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2576, rc=0) complete pengine[6640]: 2007/09/19_15:41:40 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 notice: check_rsc_parameters: Forcing restart of mysql on host-1.awale.qc.ca, type changed: mysql -> mysqld cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:30 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:40 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: --- 0.2.3638 pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3639 pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 WARN: should_dump_action: action 17 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 WARN: process_pe_message: Transition 97: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-115.bz2 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:40 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + heartbeat[15200]: 2007/09/19_15:41:41 info: killing /usr/lib/heartbeat/mgmtd -v process group 15217 with signal 15 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + mgmtd[15217]: 2007/09/19_15:41:41 info: mgmtd is shutting down tengine[6639]: 2007/09/19_15:41:41 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + heartbeat[15200]: 2007/09/19_15:41:41 info: killing /usr/lib/heartbeat/crmd process group 15216 with signal 15 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:41 info: crm_shutdown: Requesting shutdown cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:41 WARN: do_log: [[FSA]] Input I_SHUTDOWN from crm_shutdown() received in state (S_TRANSITION_ENGINE) cibmon[15210]: 2007/09/19_15:41:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: --- 0.2.3639 crmd[15216]: 2007/09/19_15:41:41 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3640 crmd[15216]: 2007/09/19_15:41:41 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: do_shutdown_req: Processing shutdown locally cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:41 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: --- 0.2.3640 cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3641 tengine[6639]: 2007/09/19_15:41:41 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:41 info: update_abort_priority: Abort priority upgraded to 1000000 heartbeat[15200]: 2007/09/19_15:41:41 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 40 ms (> 30 ms) (GSource: 0x8438de8) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - lrmd[16497]: 2007/09/19_15:41:42 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:41 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2579, rc=0) complete tengine[6639]: 2007/09/19_15:41:41 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2582, rc=254) Error tengine[6639]: 2007/09/19_15:41:41 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2580, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2583, rc=7) complete tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2581, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:42 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 notice: run_graph: Transition 97: (Complete=10, Pending=0, Fired=0, Skipped=8, Incomplete=1) pengine[6640]: 2007/09/19_15:41:42 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: unpack_graph: Unpacked transition 98: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:42 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:42 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:42 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:98:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2586, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2585, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:42 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2584, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2587, rc=0) complete tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:42 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:42 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:42 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:42 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + lrmd[16591]: 2007/09/19_15:41:43 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:43 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: --- 0.2.3641 pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_cib_diff: cib_update: Diff: +++ 0.2.3642 pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 WARN: process_pe_message: Transition 98: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-116.bz2 cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:42 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:31 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3642 cibmon[15210]: 2007/09/19_15:41:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3643 cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:43 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2590, rc=254) Error tengine[6639]: 2007/09/19_15:41:43 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:43 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2588, rc=0) complete tengine[6639]: 2007/09/19_15:41:43 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:43 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2591, rc=7) complete tengine[6639]: 2007/09/19_15:41:43 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:43 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:43 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:32 info: log_cib_diff: cib_update: Diff: --- 0.2.3644 cibmon[15210]: 2007/09/19_15:41:32 info: log_cib_diff: cib_update: Diff: +++ 0.2.3645 cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:43 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:32 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:33 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:33 info: log_cib_diff: cib_update: Diff: --- 0.2.3646 cibmon[15210]: 2007/09/19_15:41:33 info: log_cib_diff: cib_update: Diff: +++ 0.2.3647 cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2589, rc=0) complete tengine[6639]: 2007/09/19_15:41:44 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:44 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:44 notice: run_graph: Transition 98: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:44 info: unpack_graph: Unpacked transition 99: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:44 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:33 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:44 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 ERROR: cl_log: 175 messages were dropped tengine[6639]: 2007/09/19_15:41:44 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3653 pengine[6640]: 2007/09/19_15:41:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3654 pengine[6640]: 2007/09/19_15:41:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:44 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:44 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:99:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2594, rc=0) complete pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2593, rc=0) complete pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 WARN: process_pe_message: Transition 99: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-117.bz2 cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:44 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:34 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:34 info: log_cib_diff: cib_update: Diff: --- 0.2.3654 cibmon[15210]: 2007/09/19_15:41:34 info: log_cib_diff: cib_update: Diff: +++ 0.2.3655 cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:44 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2592, rc=0) complete tengine[6639]: 2007/09/19_15:41:44 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:44 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2597, rc=0) complete tengine[6639]: 2007/09/19_15:41:44 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:45 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2595, rc=0) complete tengine[6639]: 2007/09/19_15:41:45 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:34 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3655 cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3656 cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + lrmd[16712]: 2007/09/19_15:41:45 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:45 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2598, rc=254) Error tengine[6639]: 2007/09/19_15:41:45 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:45 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2596, rc=0) complete tengine[6639]: 2007/09/19_15:41:45 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3656 tengine[6639]: 2007/09/19_15:41:45 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3657 tengine[6639]: 2007/09/19_15:41:45 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:45 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3657 cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3658 cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2599, rc=7) complete tengine[6639]: 2007/09/19_15:41:45 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:45 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:45 notice: run_graph: Transition 99: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:45 info: unpack_graph: Unpacked transition 100: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:35 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: --- 0.2.3658 crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_cib_diff: cib_update: Diff: +++ 0.2.3659 crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:45 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:100:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:45 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2602, rc=0) complete tengine[6639]: 2007/09/19_15:41:45 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:45 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:45 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2601, rc=0) complete tengine[6639]: 2007/09/19_15:41:46 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:46 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2600, rc=0) complete tengine[6639]: 2007/09/19_15:41:46 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:45 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:46 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2603, rc=0) complete pengine[6640]: 2007/09/19_15:41:45 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:35 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:45 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:36 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:41:45 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:45 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3660 pengine[6640]: 2007/09/19_15:41:45 WARN: process_pe_message: Transition 100: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-118.bz2 cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3661 pengine[6640]: 2007/09/19_15:41:45 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:46 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - lrmd[16793]: 2007/09/19_15:41:46 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3661 cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3662 cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3662 cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3663 cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2606, rc=254) Error tengine[6639]: 2007/09/19_15:41:47 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2604, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2605, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: --- 0.2.3663 cibmon[15210]: 2007/09/19_15:41:36 info: log_cib_diff: cib_update: Diff: +++ 0.2.3664 cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2607, rc=7) complete tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:47 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:47 notice: run_graph: Transition 100: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: unpack_graph: Unpacked transition 101: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:47 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:36 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: cibmon_diff: [cib_diff_notify] cib_update confirmed lrmd[16887]: 2007/09/19_15:41:48 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_cib_diff: cib_update: Diff: --- 0.2.3664 crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_cib_diff: cib_update: Diff: +++ 0.2.3665 crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:47 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:101:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2610, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2609, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:47 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2608, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:48 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2611, rc=0) complete tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:47 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:48 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:47 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:47 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:47 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:37 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:41:47 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:37 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:47 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:37 info: log_cib_diff: cib_update: Diff: --- 0.2.3669 pengine[6640]: 2007/09/19_15:41:47 WARN: process_pe_message: Transition 101: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-119.bz2 cibmon[15210]: 2007/09/19_15:41:37 info: log_cib_diff: cib_update: Diff: +++ 0.2.3670 pengine[6640]: 2007/09/19_15:41:47 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:37 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:38 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:38 info: log_cib_diff: cib_update: Diff: --- 0.2.3670 cibmon[15210]: 2007/09/19_15:41:38 info: log_cib_diff: cib_update: Diff: +++ 0.2.3671 cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:48 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2614, rc=254) Error tengine[6639]: 2007/09/19_15:41:48 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2612, rc=0) complete tengine[6639]: 2007/09/19_15:41:48 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2613, rc=0) complete tengine[6639]: 2007/09/19_15:41:48 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:48 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:48 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:38 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:38 info: log_cib_diff: cib_update: Diff: --- 0.2.3672 cibmon[15210]: 2007/09/19_15:41:38 info: log_cib_diff: cib_update: Diff: +++ 0.2.3673 cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2615, rc=7) complete tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:49 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:49 notice: run_graph: Transition 101: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:49 info: unpack_graph: Unpacked transition 102: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:38 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3674 crmd[15216]: 2007/09/19_15:41:49 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:102:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:49 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3675 crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2618, rc=0) complete tengine[6639]: 2007/09/19_15:41:49 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2617, rc=0) complete tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2616, rc=0) complete tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:49 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2619, rc=0) complete tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:49 WARN: process_pe_message: Transition 102: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-120.bz2 cibmon[15210]: 2007/09/19_15:41:39 ERROR: cl_log: 59 messages were dropped pengine[6640]: 2007/09/19_15:41:49 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:39 info: log_cib_diff: cib_update: Diff: --- 0.2.3677 cibmon[15210]: 2007/09/19_15:41:39 info: log_cib_diff: cib_update: Diff: +++ 0.2.3678 cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:49 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:39 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3678 cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3679 cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - lrmd[16987]: 2007/09/19_15:41:50 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3679 cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3680 cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3680 cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3681 cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:50 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2622, rc=254) Error tengine[6639]: 2007/09/19_15:41:50 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: --- 0.2.3681 crmd[15216]: 2007/09/19_15:41:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2620, rc=0) complete tengine[6639]: 2007/09/19_15:41:50 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:40 info: log_cib_diff: cib_update: Diff: +++ 0.2.3682 crmd[15216]: 2007/09/19_15:41:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2621, rc=0) complete tengine[6639]: 2007/09/19_15:41:50 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2623, rc=7) complete tengine[6639]: 2007/09/19_15:41:50 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:50 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:50 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:40 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3682 cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3683 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:50 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:50 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:50 notice: run_graph: Transition 102: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3683 cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3684 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:41:51 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:50 info: unpack_graph: Unpacked transition 103: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:50 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:50 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:103:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:51 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2626, rc=0) complete tengine[6639]: 2007/09/19_15:41:50 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:50 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:50 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:51 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:51 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2624, rc=0) complete tengine[6639]: 2007/09/19_15:41:51 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3684 crmd[15216]: 2007/09/19_15:41:51 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2625, rc=0) complete tengine[6639]: 2007/09/19_15:41:51 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3685 crmd[15216]: 2007/09/19_15:41:51 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2629, rc=0) complete pengine[6640]: 2007/09/19_15:41:50 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 WARN: process_pe_message: Transition 103: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-121.bz2 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3685 cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3686 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: --- 0.2.3686 cibmon[15210]: 2007/09/19_15:41:41 info: log_cib_diff: cib_update: Diff: +++ 0.2.3687 cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:51 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:41 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3687 cibmon[15210]: 2007/09/19_15:41:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3688 cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:51 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2627, rc=0) complete cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + lrmd[17104]: 2007/09/19_15:41:52 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:51 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:52 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2630, rc=254) Error cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:42 info: log_cib_diff: cib_update: Diff: --- 0.2.3688 cibmon[15210]: 2007/09/19_15:41:42 info: log_cib_diff: cib_update: Diff: +++ 0.2.3689 cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:42 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 ERROR: cl_log: 159 messages were dropped cibmon[15210]: 2007/09/19_15:41:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3694 cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3695 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2628, rc=0) complete tengine[6639]: 2007/09/19_15:41:52 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2631, rc=7) complete tengine[6639]: 2007/09/19_15:41:52 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:52 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:52 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 notice: run_graph: Transition 103: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:52 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: unpack_graph: Unpacked transition 104: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:52 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:52 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:104:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:52 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2633, rc=0) complete tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:52 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2634, rc=0) complete cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + lrmd[17185]: 2007/09/19_15:41:53 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:41:52 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2632, rc=0) complete tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2635, rc=0) complete tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:52 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:52 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:53 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3695 pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3696 pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 WARN: process_pe_message: Transition 104: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-122.bz2 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:52 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:53 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2638, rc=254) Error tengine[6639]: 2007/09/19_15:41:53 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:53 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:53 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:53 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: --- 0.2.3697 cibmon[15210]: 2007/09/19_15:41:43 info: log_cib_diff: cib_update: Diff: +++ 0.2.3698 cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:43 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:53 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2636, rc=0) complete tengine[6639]: 2007/09/19_15:41:53 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2639, rc=7) complete cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3698 cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3699 cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3699 tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3700 cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2637, rc=0) complete tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:54 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:54 notice: run_graph: Transition 104: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:54 info: unpack_graph: Unpacked transition 105: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:44 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: --- 0.2.3700 crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_cib_diff: cib_update: Diff: +++ 0.2.3701 crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:54 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:105:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:54 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:54 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2642, rc=0) complete tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2641, rc=0) complete tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:54 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2640, rc=0) complete pengine[6640]: 2007/09/19_15:41:54 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:44 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:54 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:45 ERROR: cl_log: 88 messages were dropped pengine[6640]: 2007/09/19_15:41:54 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:54 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3704 pengine[6640]: 2007/09/19_15:41:54 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3705 pengine[6640]: 2007/09/19_15:41:54 WARN: process_pe_message: Transition 105: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-123.bz2 cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:54 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2647, rc=7) complete tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2643, rc=0) complete tengine[6639]: 2007/09/19_15:41:54 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3705 cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3706 cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3706 lrmd[17300]: 2007/09/19_15:41:55 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3707 cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: --- 0.2.3707 cibmon[15210]: 2007/09/19_15:41:45 info: log_cib_diff: cib_update: Diff: +++ 0.2.3708 cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:45 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:46 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:41:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:46 info: log_cib_diff: cib_update: Diff: --- 0.2.3710 crmd[15216]: 2007/09/19_15:41:55 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2646, rc=254) Error tengine[6639]: 2007/09/19_15:41:55 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:46 info: log_cib_diff: cib_update: Diff: +++ 0.2.3711 crmd[15216]: 2007/09/19_15:41:55 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2644, rc=0) complete tengine[6639]: 2007/09/19_15:41:55 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2645, rc=0) complete tengine[6639]: 2007/09/19_15:41:55 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:55 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:55 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:55 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:55 notice: run_graph: Transition 105: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:55 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: unpack_graph: Unpacked transition 106: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:55 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:55 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:55 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:41:55 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:55 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:55 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:56 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:56 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:56 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:106:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:55 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2650, rc=0) complete pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:46 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2649, rc=0) complete pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:41:56 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2648, rc=0) complete pengine[6640]: 2007/09/19_15:41:55 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:41:56 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2651, rc=0) complete pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3711 pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3712 pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 WARN: process_pe_message: Transition 106: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-124.bz2 cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:55 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:56 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3712 cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3713 cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - lrmd[17373]: 2007/09/19_15:41:56 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3713 cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3714 cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: --- 0.2.3714 cibmon[15210]: 2007/09/19_15:41:47 info: log_cib_diff: cib_update: Diff: +++ 0.2.3715 crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2652, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2654, rc=254) Error tengine[6639]: 2007/09/19_15:41:57 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:41:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2653, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:41:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2655, rc=7) complete tengine[6639]: 2007/09/19_15:41:57 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:41:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:57 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 notice: run_graph: Transition 106: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:57 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: unpack_graph: Unpacked transition 107: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:57 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:57 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:57 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:107:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2658, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2657, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:57 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2656, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:58 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2659, rc=0) complete tengine[6639]: 2007/09/19_15:41:57 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:57 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:57 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:57 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + lrmd[17481]: 2007/09/19_15:41:58 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:41:58 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:47 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:48 ERROR: cl_log: 116 messages were dropped pengine[6640]: 2007/09/19_15:41:57 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3719 pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3720 pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 WARN: process_pe_message: Transition 107: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-125.bz2 cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:57 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:48 info: log_cib_diff: cib_update: Diff: --- 0.2.3720 cibmon[15210]: 2007/09/19_15:41:48 info: log_cib_diff: cib_update: Diff: +++ 0.2.3721 cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:58 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2662, rc=254) Error tengine[6639]: 2007/09/19_15:41:58 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2660, rc=0) complete tengine[6639]: 2007/09/19_15:41:58 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2661, rc=0) complete tengine[6639]: 2007/09/19_15:41:58 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:58 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:58 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:58 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2663, rc=7) complete cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:48 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3721 cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3722 cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:58 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:41:59 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:41:59 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:41:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 notice: run_graph: Transition 107: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:41:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: unpack_graph: Unpacked transition 108: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:41:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:41:59 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 ERROR: cl_log: 1 messages were dropped tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3722 tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3723 tengine[6639]: 2007/09/19_15:41:59 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:41:59 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:41:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:59 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:108:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:41:59 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2666, rc=0) complete pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2665, rc=0) complete pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2664, rc=0) complete pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:41:59 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2667, rc=0) complete pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:41:59 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:49 ERROR: cl_log: 88 messages were dropped pengine[6640]: 2007/09/19_15:41:59 WARN: process_pe_message: Transition 108: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-126.bz2 cibmon[15210]: 2007/09/19_15:41:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:41:59 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: --- 0.2.3726 cibmon[15210]: 2007/09/19_15:41:49 info: log_cib_diff: cib_update: Diff: +++ 0.2.3727 cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:41:59 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:49 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3727 cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3728 cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - lrmd[17575]: 2007/09/19_15:42:00 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3728 cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3729 cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3729 cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3730 cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2668, rc=0) complete tengine[6639]: 2007/09/19_15:42:00 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2670, rc=254) Error tengine[6639]: 2007/09/19_15:42:00 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:00 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2671, rc=7) complete tengine[6639]: 2007/09/19_15:42:00 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: --- 0.2.3730 tengine[6639]: 2007/09/19_15:42:00 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:50 info: log_cib_diff: cib_update: Diff: +++ 0.2.3731 tengine[6639]: 2007/09/19_15:42:00 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:00 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:50 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3731 cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3732 cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2669, rc=0) complete tengine[6639]: 2007/09/19_15:42:00 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:00 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:00 notice: run_graph: Transition 108: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:00 info: unpack_graph: Unpacked transition 109: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3732 crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3733 crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:109:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:01 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2673, rc=0) complete tengine[6639]: 2007/09/19_15:42:00 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:01 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2674, rc=0) complete tengine[6639]: 2007/09/19_15:42:00 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:01 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2672, rc=0) complete tengine[6639]: 2007/09/19_15:42:01 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:01 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2675, rc=0) complete tengine[6639]: 2007/09/19_15:42:01 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:01 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:01 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:00 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:00 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3733 pengine[6640]: 2007/09/19_15:42:00 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3734 pengine[6640]: 2007/09/19_15:42:00 WARN: process_pe_message: Transition 109: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-127.bz2 cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:00 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 ERROR: cl_log: 2 messages were dropped cibmon[15210]: 2007/09/19_15:41:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3734 cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3735 cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - lrmd[17669]: 2007/09/19_15:42:02 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: --- 0.2.3735 cibmon[15210]: 2007/09/19_15:41:51 info: log_cib_diff: cib_update: Diff: +++ 0.2.3736 cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:51 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:52 info: log_cib_diff: cib_update: Diff: --- 0.2.3736 cibmon[15210]: 2007/09/19_15:41:52 info: log_cib_diff: cib_update: Diff: +++ 0.2.3737 crmd[15216]: 2007/09/19_15:42:02 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2678, rc=254) Error tengine[6639]: 2007/09/19_15:42:02 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2676, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2677, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:02 info: perform_op:2783: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:42:02 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2679, rc=7) complete tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:03 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 210 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:42:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:03 info: G_SIG_dispatch: started at 430129757 should have started at 430129736 crmd[15216]: 2007/09/19_15:42:02 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:02 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:02 notice: run_graph: Transition 109: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:52 info: log_cib_diff: cib_update: Diff: --- 0.2.3737 crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: unpack_graph: Unpacked transition 110: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:52 info: log_cib_diff: cib_update: Diff: +++ 0.2.3738 crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:02 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:110:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2681, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2682, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2680, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:03 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2685, rc=0) complete tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:02 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:03 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + lrmd[17761]: 2007/09/19_15:42:03 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory tengine[6639]: 2007/09/19_15:42:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:52 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:53 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3742 pengine[6640]: 2007/09/19_15:42:02 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3743 pengine[6640]: 2007/09/19_15:42:02 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 WARN: process_pe_message: Transition 110: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-128.bz2 cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3743 cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3744 cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:03 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2686, rc=254) Error tengine[6639]: 2007/09/19_15:42:03 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: --- 0.2.3744 crmd[15216]: 2007/09/19_15:42:04 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2684, rc=0) complete tengine[6639]: 2007/09/19_15:42:03 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:53 info: log_cib_diff: cib_update: Diff: +++ 0.2.3745 crmd[15216]: 2007/09/19_15:42:04 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2687, rc=7) complete tengine[6639]: 2007/09/19_15:42:03 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:03 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:04 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:53 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3745 cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3746 cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:04 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3746 cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3747 cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2683, rc=0) complete tengine[6639]: 2007/09/19_15:42:04 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:04 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:04 notice: run_graph: Transition 110: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:04 info: unpack_graph: Unpacked transition 111: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 ERROR: cl_log: 59 messages were dropped tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: --- 0.2.3749 tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_cib_diff: cib_update: Diff: +++ 0.2.3750 tengine[6639]: 2007/09/19_15:42:04 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:04 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:04 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:04 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:04 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:111:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:04 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2690, rc=0) complete pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:04 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2689, rc=0) complete pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:05 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2688, rc=0) complete pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:54 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:04 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:55 ERROR: cl_log: 30 messages were dropped pengine[6640]: 2007/09/19_15:42:04 WARN: process_pe_message: Transition 111: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-129.bz2 cibmon[15210]: 2007/09/19_15:41:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:04 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3751 tengine[6639]: 2007/09/19_15:42:05 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3752 cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - lrmd[17872]: 2007/09/19_15:42:05 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:05 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2691, rc=0) complete tengine[6639]: 2007/09/19_15:42:05 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3752 cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3753 cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3753 cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3754 cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: --- 0.2.3754 cibmon[15210]: 2007/09/19_15:41:55 info: log_cib_diff: cib_update: Diff: +++ 0.2.3755 cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:55 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:56 info: log_cib_diff: cib_update: Diff: --- 0.2.3755 cibmon[15210]: 2007/09/19_15:41:56 info: log_cib_diff: cib_update: Diff: +++ 0.2.3756 cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:56 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:41:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2692, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3759 crmd[15216]: 2007/09/19_15:42:05 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2694, rc=254) Error tengine[6639]: 2007/09/19_15:42:06 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3760 crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2693, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2695, rc=7) complete tengine[6639]: 2007/09/19_15:42:06 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:06 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:06 notice: run_graph: Transition 111: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3760 cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3761 cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:06 info: unpack_graph: Unpacked transition 112: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:112:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2698, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2697, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:06 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2696, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:06 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2700, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: --- 0.2.3761 cibmon[15210]: 2007/09/19_15:41:57 info: log_cib_diff: cib_update: Diff: +++ 0.2.3762 lrmd[17968]: 2007/09/19_15:42:07 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2699, rc=0) complete tengine[6639]: 2007/09/19_15:42:06 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:07 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:06 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 WARN: process_pe_message: Transition 112: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-130.bz2 cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:06 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:57 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 ERROR: cl_log: 116 messages were dropped crmd[15216]: 2007/09/19_15:42:07 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2702, rc=254) Error tengine[6639]: 2007/09/19_15:42:07 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:42:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:41:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2701, rc=0) complete tengine[6639]: 2007/09/19_15:42:07 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:42:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3766 crmd[15216]: 2007/09/19_15:42:07 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2703, rc=7) complete tengine[6639]: 2007/09/19_15:42:07 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:42:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3767 crmd[15216]: 2007/09/19_15:42:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:07 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:07 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:07 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:07 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:07 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:07 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:07 notice: run_graph: Transition 112: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:07 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:07 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: unpack_graph: Unpacked transition 113: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:07 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:07 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:113:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2706, rc=0) complete tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:08 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2705, rc=0) complete tengine[6639]: 2007/09/19_15:42:07 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:41:58 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:42:08 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2704, rc=0) complete tengine[6639]: 2007/09/19_15:42:07 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:41:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:08 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3767 tengine[6639]: 2007/09/19_15:42:08 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3768 pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - lrmd[18057]: 2007/09/19_15:42:09 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2709, rc=0) complete tengine[6639]: 2007/09/19_15:42:08 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:07 WARN: process_pe_message: Transition 113: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-131.bz2 cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:07 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:41:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: --- 0.2.3769 cibmon[15210]: 2007/09/19_15:41:58 info: log_cib_diff: cib_update: Diff: +++ 0.2.3770 cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:58 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:41:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3770 cibmon[15210]: 2007/09/19_15:41:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3771 cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:41:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:41:59 info: log_cib_diff: cib_update: Diff: --- 0.2.3774 cibmon[15210]: 2007/09/19_15:41:59 info: log_cib_diff: cib_update: Diff: +++ 0.2.3775 cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:09 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2710, rc=254) Error tengine[6639]: 2007/09/19_15:42:09 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2708, rc=0) complete tengine[6639]: 2007/09/19_15:42:09 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:09 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2711, rc=7) complete tengine[6639]: 2007/09/19_15:42:09 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:09 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:09 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:41:59 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:42:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3775 cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3776 cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3776 cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3777 cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2707, rc=0) complete tengine[6639]: 2007/09/19_15:42:09 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3777 cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3778 cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:09 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:09 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:09 notice: run_graph: Transition 113: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:09 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:42:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: --- 0.2.3778 cibmon[15210]: 2007/09/19_15:42:00 info: log_cib_diff: cib_update: Diff: +++ 0.2.3779 cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:09 info: unpack_graph: Unpacked transition 114: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:09 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:114:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2714, rc=0) complete tengine[6639]: 2007/09/19_15:42:09 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:09 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:09 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:00 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:09 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3779 pengine[6640]: 2007/09/19_15:42:09 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3780 crmd[15216]: 2007/09/19_15:42:10 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2713, rc=0) complete tengine[6639]: 2007/09/19_15:42:10 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:10 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2712, rc=0) complete tengine[6639]: 2007/09/19_15:42:10 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:10 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2715, rc=0) complete tengine[6639]: 2007/09/19_15:42:10 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:09 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 WARN: process_pe_message: Transition 114: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-132.bz2 cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:09 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3780 cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3781 cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:10 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 ERROR: cl_log: 31 messages were dropped cibmon[15210]: 2007/09/19_15:42:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: --- 0.2.3782 cibmon[15210]: 2007/09/19_15:42:01 info: log_cib_diff: cib_update: Diff: +++ 0.2.3783 cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - lrmd[18171]: 2007/09/19_15:42:11 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:01 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:42:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3783 cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3784 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3784 cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3785 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3785 cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3786 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2718, rc=254) Error tengine[6639]: 2007/09/19_15:42:11 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2716, rc=0) complete tengine[6639]: 2007/09/19_15:42:11 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2719, rc=7) complete tengine[6639]: 2007/09/19_15:42:11 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2717, rc=0) complete tengine[6639]: 2007/09/19_15:42:11 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:11 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:11 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: --- 0.2.3786 cibmon[15210]: 2007/09/19_15:42:02 info: log_cib_diff: cib_update: Diff: +++ 0.2.3787 cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:11 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:11 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:11 notice: run_graph: Transition 114: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: unpack_graph: Unpacked transition 115: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:02 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:03 ERROR: cl_log: 88 messages were dropped crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3790 crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3791 crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:115:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:11 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2721, rc=0) complete tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:11 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:11 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - lrmd[18265]: 2007/09/19_15:42:12 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:12 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2722, rc=0) complete tengine[6639]: 2007/09/19_15:42:11 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2720, rc=0) complete tengine[6639]: 2007/09/19_15:42:12 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:12 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2723, rc=0) complete tengine[6639]: 2007/09/19_15:42:12 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:12 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2726, rc=254) Error tengine[6639]: 2007/09/19_15:42:12 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2724, rc=0) complete tengine[6639]: 2007/09/19_15:42:12 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:12 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:12 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:12 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:11 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:03 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:42:11 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:11 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:03 info: log_cib_diff: cib_update: Diff: --- 0.2.3791 pengine[6640]: 2007/09/19_15:42:11 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:03 info: log_cib_diff: cib_update: Diff: +++ 0.2.3792 crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2727, rc=7) complete tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:11 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:11 WARN: process_pe_message: Transition 115: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-133.bz2 cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:11 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:03 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3792 cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3793 cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2725, rc=0) complete cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:13 info: perform_op:2783: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:42:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:13 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:13 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 notice: run_graph: Transition 115: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: unpack_graph: Unpacked transition 116: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:04 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:13 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3793 crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3794 crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:116:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2729, rc=0) complete tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:13 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:13 info: te_pseudo_action: Pseudo action 36 fired and confirmed cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2730, rc=0) complete tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:13 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2728, rc=0) complete tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2733, rc=0) complete tengine[6639]: 2007/09/19_15:42:13 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:13 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:13 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:13 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:04 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:42:13 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:13 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3794 pengine[6640]: 2007/09/19_15:42:13 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3795 pengine[6640]: 2007/09/19_15:42:13 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:13 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:13 WARN: process_pe_message: Transition 116: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-134.bz2 cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - lrmd[18357]: 2007/09/19_15:42:14 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory pengine[6640]: 2007/09/19_15:42:13 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: --- 0.2.3795 cibmon[15210]: 2007/09/19_15:42:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.3796 cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:04 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:42:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:05 info: log_cib_diff: cib_update: Diff: --- 0.2.3797 cibmon[15210]: 2007/09/19_15:42:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.3798 cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:05 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3799 cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3800 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:14 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2732, rc=0) complete tengine[6639]: 2007/09/19_15:42:14 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:14 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2734, rc=254) Error tengine[6639]: 2007/09/19_15:42:14 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2735, rc=7) complete tengine[6639]: 2007/09/19_15:42:14 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:14 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:14 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3800 cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3801 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3801 cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3802 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3802 cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3803 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:15 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2731, rc=0) complete tengine[6639]: 2007/09/19_15:42:15 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:15 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:15 notice: run_graph: Transition 116: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:15 info: unpack_graph: Unpacked transition 117: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3803 crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3804 crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:15 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:117:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:15 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:15 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:15 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2738, rc=0) complete tengine[6639]: 2007/09/19_15:42:15 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2737, rc=0) complete tengine[6639]: 2007/09/19_15:42:15 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:15 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:15 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2736, rc=0) complete pengine[6640]: 2007/09/19_15:42:15 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:15 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:15 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3804 pengine[6640]: 2007/09/19_15:42:15 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3805 pengine[6640]: 2007/09/19_15:42:15 WARN: process_pe_message: Transition 117: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-135.bz2 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:15 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:16 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2739, rc=0) complete tengine[6639]: 2007/09/19_15:42:16 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 ERROR: cl_log: 29 messages were dropped cibmon[15210]: 2007/09/19_15:42:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: --- 0.2.3806 cibmon[15210]: 2007/09/19_15:42:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.3807 cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:16 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:06 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:42:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:07 info: log_cib_diff: cib_update: Diff: --- 0.2.3808 cibmon[15210]: 2007/09/19_15:42:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.3809 cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - lrmd[18467]: 2007/09/19_15:42:16 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:07 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:42:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:08 info: log_cib_diff: cib_update: Diff: --- 0.2.3811 cibmon[15210]: 2007/09/19_15:42:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.3812 cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:08 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 ERROR: cl_log: 88 messages were dropped cibmon[15210]: 2007/09/19_15:42:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3815 cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3816 cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3816 cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3817 cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2740, rc=0) complete tengine[6639]: 2007/09/19_15:42:16 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:16 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2742, rc=254) Error tengine[6639]: 2007/09/19_15:42:16 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:42:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2741, rc=0) complete tengine[6639]: 2007/09/19_15:42:16 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:42:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2743, rc=7) complete tengine[6639]: 2007/09/19_15:42:16 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:42:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:16 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:16 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:17 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 notice: run_graph: Transition 117: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:17 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: unpack_graph: Unpacked transition 118: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:17 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:17 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + lrmd[18562]: 2007/09/19_15:42:18 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:118:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:17 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2746, rc=0) complete tengine[6639]: 2007/09/19_15:42:17 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:17 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2745, rc=0) complete tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2744, rc=0) complete tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2748, rc=0) complete tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:17 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2747, rc=0) complete tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:17 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3817 pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3818 pengine[6640]: 2007/09/19_15:42:17 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 WARN: process_pe_message: Transition 118: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-136.bz2 cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:17 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: --- 0.2.3818 cibmon[15210]: 2007/09/19_15:42:09 info: log_cib_diff: cib_update: Diff: +++ 0.2.3819 cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:09 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:18 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2750, rc=254) Error tengine[6639]: 2007/09/19_15:42:18 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:42:18 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:18 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2751, rc=7) complete tengine[6639]: 2007/09/19_15:42:18 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:42:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3819 crmd[15216]: 2007/09/19_15:42:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2749, rc=0) complete tengine[6639]: 2007/09/19_15:42:18 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:42:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3820 crmd[15216]: 2007/09/19_15:42:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:18 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:18 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:18 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:18 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:18 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:18 notice: run_graph: Transition 118: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:18 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: unpack_graph: Unpacked transition 119: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:18 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:18 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:19 WARN: G_CH_prepare_int: working on IPC channel took 130 ms (> 100 ms) crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:19 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 620 ms (> 100 ms) before being called (GSource: 0x8877298) crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:18 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:19 info: G_SIG_dispatch: started at 430131410 should have started at 430131348 crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:18 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:18 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:18 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:19 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:19 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:19 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:19 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:119:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:19 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:19 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2754, rc=0) complete pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:19 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2753, rc=0) complete pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2752, rc=0) complete pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:18 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3820 pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3821 pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 WARN: process_pe_message: Transition 119: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-137.bz2 cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:18 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3821 cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3822 cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: --- 0.2.3822 cibmon[15210]: 2007/09/19_15:42:10 info: log_cib_diff: cib_update: Diff: +++ 0.2.3823 cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + lrmd[18648]: 2007/09/19_15:42:20 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:20 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2758, rc=254) Error tengine[6639]: 2007/09/19_15:42:20 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2757, rc=0) complete tengine[6639]: 2007/09/19_15:42:20 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:10 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2756, rc=0) complete tengine[6639]: 2007/09/19_15:42:20 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:20 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2755, rc=0) complete tengine[6639]: 2007/09/19_15:42:20 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3823 tengine[6639]: 2007/09/19_15:42:20 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3824 tengine[6639]: 2007/09/19_15:42:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3824 cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3825 cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:20 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3825 cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3826 cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:21 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2759, rc=7) complete cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3826 cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3827 cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:21 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:21 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: --- 0.2.3827 crmd[15216]: 2007/09/19_15:42:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:21 notice: run_graph: Transition 119: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:42:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.3828 crmd[15216]: 2007/09/19_15:42:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:11 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3828 cibmon[15210]: 2007/09/19_15:42:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3829 cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:21 info: unpack_graph: Unpacked transition 120: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:21 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:21 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_cib_diff: cib_update: Diff: --- 0.2.3829 crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.3830 crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:21 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:120:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:21 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2762, rc=0) complete tengine[6639]: 2007/09/19_15:42:21 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:21 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:21 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:21 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:21 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2760, rc=0) complete tengine[6639]: 2007/09/19_15:42:21 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:21 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:21 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 WARN: process_pe_message: Transition 120: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-138.bz2 cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:12 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 ERROR: cl_log: 60 messages were dropped cibmon[15210]: 2007/09/19_15:42:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3832 cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3833 cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - lrmd[18763]: 2007/09/19_15:42:22 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2761, rc=0) complete tengine[6639]: 2007/09/19_15:42:21 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:22 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2763, rc=0) complete tengine[6639]: 2007/09/19_15:42:22 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:22 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2766, rc=254) Error tengine[6639]: 2007/09/19_15:42:22 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:22 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2764, rc=0) complete tengine[6639]: 2007/09/19_15:42:22 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2765, rc=0) complete tengine[6639]: 2007/09/19_15:42:22 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:22 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2767, rc=7) complete tengine[6639]: 2007/09/19_15:42:22 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:22 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:42:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3833 cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3834 cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:23 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:23 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:23 notice: run_graph: Transition 120: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: unpack_graph: Unpacked transition 121: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: --- 0.2.3834 crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.3835 tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:23 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:23 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:23 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:121:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:23 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:23 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:23 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2770, rc=0) complete pengine[6640]: 2007/09/19_15:42:23 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:23 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2769, rc=0) complete pengine[6640]: 2007/09/19_15:42:23 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:23 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2768, rc=0) complete pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:13 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:23 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:14 ERROR: cl_log: 117 messages were dropped pengine[6640]: 2007/09/19_15:42:23 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:23 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3839 pengine[6640]: 2007/09/19_15:42:23 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3840 pengine[6640]: 2007/09/19_15:42:23 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:23 WARN: process_pe_message: Transition 121: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-139.bz2 cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:23 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - lrmd[18857]: 2007/09/19_15:42:24 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:23 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2771, rc=0) complete tengine[6639]: 2007/09/19_15:42:23 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:23 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:14 info: log_cib_diff: cib_update: Diff: --- 0.2.3840 cibmon[15210]: 2007/09/19_15:42:14 info: log_cib_diff: cib_update: Diff: +++ 0.2.3841 cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:14 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3841 cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3842 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3842 cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3843 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2774, rc=254) Error tengine[6639]: 2007/09/19_15:42:24 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2772, rc=0) complete tengine[6639]: 2007/09/19_15:42:24 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2775, rc=7) complete tengine[6639]: 2007/09/19_15:42:24 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:24 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:24 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3843 cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3844 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: --- 0.2.3844 cibmon[15210]: 2007/09/19_15:42:15 info: log_cib_diff: cib_update: Diff: +++ 0.2.3845 cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:24 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2773, rc=0) complete tengine[6639]: 2007/09/19_15:42:24 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:24 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:24 notice: run_graph: Transition 121: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:24 info: unpack_graph: Unpacked transition 122: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:24 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:24 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:15 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3845 tengine[6639]: 2007/09/19_15:42:24 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3846 tengine[6639]: 2007/09/19_15:42:24 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:24 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:25 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:25 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:24 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:122:cdefb5a2-efb8-49af-83f0-5a7f0e624015) pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2776, rc=0) complete pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2778, rc=0) complete pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2777, rc=0) complete pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:24 WARN: process_pe_message: Transition 122: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-140.bz2 cibmon[15210]: 2007/09/19_15:42:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:24 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3846 cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3847 cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:25 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2781, rc=0) complete tengine[6639]: 2007/09/19_15:42:25 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3847 cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3848 cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed lrmd[18948]: 2007/09/19_15:42:26 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3848 cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3849 cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: --- 0.2.3849 cibmon[15210]: 2007/09/19_15:42:16 info: log_cib_diff: cib_update: Diff: +++ 0.2.3850 cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:16 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3850 crmd[15216]: 2007/09/19_15:42:26 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2782, rc=254) Error tengine[6639]: 2007/09/19_15:42:26 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3851 crmd[15216]: 2007/09/19_15:42:26 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2780, rc=0) complete tengine[6639]: 2007/09/19_15:42:26 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:26 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:26 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:26 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3851 cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3852 cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2783, rc=7) complete tengine[6639]: 2007/09/19_15:42:26 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2779, rc=0) complete cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3852 cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3853 cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:26 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:26 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:26 notice: run_graph: Transition 122: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[15210]: 2007/09/19_15:42:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: --- 0.2.3853 cibmon[15210]: 2007/09/19_15:42:17 info: log_cib_diff: cib_update: Diff: +++ 0.2.3854 cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:26 info: unpack_graph: Unpacked transition 123: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:123:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:27 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2786, rc=0) complete tengine[6639]: 2007/09/19_15:42:26 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:27 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2785, rc=0) complete tengine[6639]: 2007/09/19_15:42:26 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:26 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:17 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:27 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2784, rc=0) complete tengine[6639]: 2007/09/19_15:42:27 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 ERROR: cl_log: 59 messages were dropped crmd[15216]: 2007/09/19_15:42:27 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2787, rc=0) complete tengine[6639]: 2007/09/19_15:42:27 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:27 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_cib_diff: cib_update: Diff: --- 0.2.3856 pengine[6640]: 2007/09/19_15:42:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.3857 pengine[6640]: 2007/09/19_15:42:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - lrmd[19059]: 2007/09/19_15:42:28 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:28 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2790, rc=254) Error tengine[6639]: 2007/09/19_15:42:27 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2788, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error pengine[6640]: 2007/09/19_15:42:26 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:28 info: update_abort_priority: Abort priority upgraded to 1 pengine[6640]: 2007/09/19_15:42:26 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:28 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[6640]: 2007/09/19_15:42:26 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 WARN: process_pe_message: Transition 123: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-141.bz2 cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:26 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:18 info: log_cib_diff: cib_update: Diff: --- 0.2.3857 crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2789, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:18 info: log_cib_diff: cib_update: Diff: +++ 0.2.3858 crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2791, rc=7) complete tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:28 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:28 notice: run_graph: Transition 123: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:28 info: unpack_graph: Unpacked transition 124: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:18 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:19 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:19 info: log_cib_diff: cib_update: Diff: --- 0.2.3859 crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:19 info: log_cib_diff: cib_update: Diff: +++ 0.2.3860 crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:124:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2794, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2793, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:28 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2792, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:28 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:29 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2795, rc=0) complete tengine[6639]: 2007/09/19_15:42:28 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 WARN: process_pe_message: Transition 124: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-142.bz2 cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:29 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:19 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 ERROR: cl_log: 59 messages were dropped cibmon[15210]: 2007/09/19_15:42:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3862 cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3863 cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3863 cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3864 lrmd[19153]: 2007/09/19_15:42:29 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3864 cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3865 cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2796, rc=0) complete tengine[6639]: 2007/09/19_15:42:29 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:20 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:42:29 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2798, rc=254) Error tengine[6639]: 2007/09/19_15:42:29 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2797, rc=0) complete tengine[6639]: 2007/09/19_15:42:29 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: --- 0.2.3865 crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2799, rc=7) complete tengine[6639]: 2007/09/19_15:42:29 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:20 info: log_cib_diff: cib_update: Diff: +++ 0.2.3866 crmd[15216]: 2007/09/19_15:42:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:29 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:30 info: run_graph: ==================================================== cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:30 notice: run_graph: Transition 124: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:20 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 ERROR: cl_log: 1 messages were dropped pengine[6640]: 2007/09/19_15:42:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[15210]: 2007/09/19_15:42:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3866 pengine[6640]: 2007/09/19_15:42:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3867 pengine[6640]: 2007/09/19_15:42:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:42:30 info: perform_op:2799: operations on resource IPaddr_10_0_0_59 already delayed crmd[15216]: 2007/09/19_15:42:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:30 info: unpack_graph: Unpacked transition 125: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:30 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:30 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: group_print: Resource Group: group-DW cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:125:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2802, rc=0) complete tengine[6639]: 2007/09/19_15:42:30 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2801, rc=0) complete tengine[6639]: 2007/09/19_15:42:30 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2800, rc=0) complete tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:30 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2803, rc=0) complete tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3867 pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3868 pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - tengine[6639]: 2007/09/19_15:42:30 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:30 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - lrmd[19247]: 2007/09/19_15:42:31 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory pengine[6640]: 2007/09/19_15:42:30 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 WARN: process_pe_message: Transition 125: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-143.bz2 cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - pengine[6640]: 2007/09/19_15:42:30 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3868 cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3869 cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: --- 0.2.3869 cibmon[15210]: 2007/09/19_15:42:21 info: log_cib_diff: cib_update: Diff: +++ 0.2.3870 cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:31 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=2804, rc=0) complete tengine[6639]: 2007/09/19_15:42:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:31 ERROR: process_lrm_event: LRM operation mysql_monitor_0 (call=2806, rc=254) Error tengine[6639]: 2007/09/19_15:42:31 WARN: status_from_rc: Action monitor on host-1.awale.qc.ca failed (target: vs. rc: 254): Error cibmon[15210]: 2007/09/19_15:42:21 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:31 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=2805, rc=0) complete tengine[6639]: 2007/09/19_15:42:31 info: update_abort_priority: Abort priority upgraded to 1 cibmon[15210]: 2007/09/19_15:42:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[6639]: 2007/09/19_15:42:31 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3870 tengine[6639]: 2007/09/19_15:42:31 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3871 cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3871 cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3872 cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + heartbeat[15200]: 2007/09/19_15:42:32 info: Core process 15203 exited. 5 remaining cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=2807, rc=7) complete tengine[6639]: 2007/09/19_15:42:31 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' heartbeat[15200]: 2007/09/19_15:42:32 info: Core process 15205 exited. 4 remaining cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:32 info: match_graph_event: Action msg_last_monitor_0 (16) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[6639]: 2007/09/19_15:42:32 info: run_graph: ==================================================== pengine[6640]: 2007/09/19_15:42:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[6639]: 2007/09/19_15:42:32 notice: run_graph: Transition 125: (Complete=10, Pending=0, Fired=0, Skipped=9, Incomplete=1) pengine[6640]: 2007/09/19_15:42:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=9:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: unpack_graph: Unpacked transition 126: 20 actions in 20 synapses pengine[6640]: 2007/09/19_15:42:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=10:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: te_pseudo_action: Pseudo action 26 fired and confirmed pengine[6640]: 2007/09/19_15:42:32 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=11:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: determine_online_status: Node host-1.awale.qc.ca is shutting down cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=12:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 WARN: unpack_rsc_op: Processing failed op (mysql_stop_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=13:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 WARN: unpack_rsc_op: Handling failed stop for mysql on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=14:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 12: share-FS_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_0) on host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: --- 0.2.3873 crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=15:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: group_print: Resource Group: group-DW heartbeat[15200]: 2007/09/19_15:42:32 info: Core process 15206 exited. 3 remaining cibmon[15210]: 2007/09/19_15:42:22 info: log_cib_diff: cib_update: Diff: +++ 0.2.3874 crmd[15216]: 2007/09/19_15:42:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=16:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015) tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca heartbeat[15200]: 2007/09/19_15:42:32 info: Core process 15207 exited. 2 remaining cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=2809, rc=0) complete tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2810, rc=0) complete tengine[6639]: 2007/09/19_15:42:32 info: send_rsc_command: Initiating action 16: msg_last_monitor_0 on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - heartbeat[15200]: 2007/09/19_15:42:32 info: Core process 15204 exited. 1 remaining cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - ccm[15211]: 2007/09/19_15:42:32 ERROR: Lost connection to heartbeat service. Need to bail out. cib[15212]: 2007/09/19_15:42:32 ERROR: cib_ha_connection_destroy: Heartbeat connection lost! Exiting. lrmd[19358]: 2007/09/19_15:42:33 ERROR: (raexeclsb.c:execra:265) execv failed for /etc/init.d/mysql: No such file or directory crmd[15216]: 2007/09/19_15:42:32 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2808, rc=0) complete stonithd[15214]: 2007/09/19_15:42:32 ERROR: Disconnected with heartbeat daemon attrd[15215]: 2007/09/19_15:42:32 CRIT: attrd_ha_dispatch: Lost connection to heartbeat service. tengine[6639]: 2007/09/19_15:42:32 info: te_pseudo_action: Pseudo action 36 fired and confirmed pengine[6640]: 2007/09/19_15:42:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca heartbeat[15200]: 2007/09/19_15:42:32 info: host-1.awale.qc.ca Heartbeat shutdown complete. cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cib[15212]: 2007/09/19_15:42:32 ERROR: crm_abort: main: Triggered non-fatal assert at main.c:213 : g_hash_table_size(client_list) == 0 crmd[15216]: 2007/09/19_15:42:32 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=2811, rc=0) complete stonithd[15214]: 2007/09/19_15:42:32 notice: /usr/lib/heartbeat/stonithd normally quit. attrd[15215]: 2007/09/19_15:42:32 CRIT: attrd_ha_connection_destroy: Lost connection to heartbeat service! tengine[6639]: 2007/09/19_15:42:32 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - cib[15212]: 2007/09/19_15:42:32 WARN: main: Not all clients gone at exit crmd[15216]: 2007/09/19_15:42:32 CRIT: crmd_ha_msg_dispatch: Lost connection to heartbeat service. attrd[15215]: 2007/09/19_15:42:32 info: main: Exiting... tengine[6639]: 2007/09/19_15:42:32 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: mem_handle_func:IPC broken, ccm is dead before the client! tengine[6639]: 2007/09/19_15:42:32 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: mysql (lsb:mysqld): Started host-1.awale.qc.ca (unmanaged) FAILED cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1. tengine[6639]: 2007/09/19_15:42:32 info: match_graph_event: Action share-FS_monitor_0 (12) confirmed on host-1.awale.qc.ca pengine[6640]: 2007/09/19_15:42:32 info: native_print: msg_last (heartbeat:msg): Stopped cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_TRANSITION_ENGINE) tengine[6639]: 2007/09/19_15:42:32 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[6640]: 2007/09/19_15:42:32 WARN: custom_action: Action mysql_monitor_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_RECOVERY [ input=I_ERROR cause=C_CCM_CALLBACK origin=ccm_dispatch ] tengine[6639]: 2007/09/19_15:42:32 info: update_abort_priority: Abort action 0 superceeded by 3 pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource msg_first cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:42:33 ERROR: notify_client: client for the operation operation monitor[2814] on lsb::mysql::mysql for client 15216, its parameters: CRM_meta_op_target_rc=[7] CRM_meta_timeout=[15000] crm_feature_set=[1.0.9] does not exist and client requested notification. crmd[15216]: 2007/09/19_15:42:32 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported tengine[6639]: 2007/09/19_15:42:32 ERROR: cib_native_msgready: Message pending on command channel [15212] pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource vmstat-mon cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: do_election_vote: Not voting in election, we're in state S_RECOVERY tengine[6639]: 2007/09/19_15:42:32 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_dc_release: DC role released tengine[6639]: 2007/09/19_15:42:32 ERROR: MSG: No message to dump pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource share-FS cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to pengine: [6640] tengine[6639]: 2007/09/19_15:42:32 info: cib_native_msgready: Lost connection to the CIB service [15212]. pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + lrmd[15213]: 2007/09/19_15:42:33 ERROR: notify_client: client for the operation operation monitor[2812] on heartbeat::drbdlinks::share-drbdlinks for client 15216, its parameters: CRM_meta_op_target_rc=[7] 1=[--config] 2=[/etc/drbdlinks.d/share.conf] CRM_meta_timeout=[15000] crm_feature_set=[1.0.9] does not exist and client requested notification. crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] tengine[6639]: 2007/09/19_15:42:32 CRIT: cib_native_dispatch: Lost connection to the CIB service [15212/callback]. pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: do_log: [[FSA]] Input I_STOP from do_recover() received in state (S_RECOVERY) tengine[6639]: 2007/09/19_15:42:32 ERROR: stonithd_op_result_ready: failed due to not on signon status. pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource mysql cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: State transition S_RECOVERY -> S_STOPPING [ input=I_STOP cause=C_FSA_INTERNAL origin=do_recover ] tengine[6639]: 2007/09/19_15:42:32 ERROR: tengine_stonith_connection_destroy: Fencing daemon has left us pengine[6640]: 2007/09/19_15:42:32 WARN: native_color: Resource msg_last cannot run anywhere cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_dc_release: DC role released tengine[6639]: 2007/09/19_15:42:32 ERROR: subsystem_msg_dispatch: The server 15216 has left us: Shutting down...NOW pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop msg_first cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to pengine: [6640] pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the pengine pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop share-FS cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to pengine: [6640] pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the tengine pengine[6640]: 2007/09/19_15:42:32 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] pengine[6640]: 2007/09/19_15:42:32 WARN: custom_action: Action mysql_stop_0 (unmanaged) cibmon[15210]: 2007/09/19_15:42:22 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Waiting for subsystems to exit pengine[6640]: 2007/09/19_15:42:32 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[15210]: 2007/09/19_15:42:23 ERROR: cl_log: 1 messages were dropped crmd[15216]: 2007/09/19_15:42:32 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs pengine[6640]: 2007/09/19_15:42:32 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 WARN: do_log: [[FSA]] Input I_PENDING from do_election_vote() received in state (S_STOPPING) pengine[6640]: 2007/09/19_15:42:32 WARN: should_dump_action: action 23 (mysql_stop_0) was for an unmanaged resource (mysql) cibmon[15210]: 2007/09/19_15:42:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3874 crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the pengine pengine[6640]: 2007/09/19_15:42:32 WARN: process_pe_message: Transition 126: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-144.bz2 cibmon[15210]: 2007/09/19_15:42:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3875 crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to pengine: [6640] pengine[6640]: 2007/09/19_15:42:32 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the tengine pengine[6640]: 2007/09/19_15:42:32 info: pengine_shutdown: Exiting PEngine (SIGTERM) cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:42:33 ERROR: notify_client: client for the operation operation monitor[2813] on ocf::IPaddr::IPaddr_10_0_0_59 for client 15216, its parameters: ip=[10.0.0.59] CRM_meta_op_target_rc=[7] CRM_meta_timeout=[15000] crm_feature_set=[1.0.9] does not exist and client requested notification. crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - lrmd[15213]: 2007/09/19_15:42:33 ERROR: notify_client: client for the operation operation monitor[2815] on heartbeat::msg::msg_last for client 15216, its parameters: CRM_meta_op_target_rc=[7] 1=[last] CRM_meta_timeout=[15000] crm_feature_set=[1.0.9] does not exist and client requested notification. crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Waiting for subsystems to exit cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: crmdManagedChildDied: Process pengine:[6640] exited (signal=0, exitcode=0) cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the tengine cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Waiting for subsystems to exit cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: process_client_disconnect: Received HUP from pengine:[-1] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Terminating the tengine cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: stop_subsystem: Sent -TERM to tengine: [6639] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_shutdown: Waiting for subsystems to exit cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: cib_native_msgready: Lost connection to the CIB service [15212]. cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 CRIT: cib_native_dispatch: Lost connection to the CIB service [15212/callback]. cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated... cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: do_log: [[FSA]] Input I_ERROR from crmd_cib_connection_destroy() received in state (S_STOPPING) cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_ERROR cause=C_FSA_INTERNAL origin=crmd_cib_connection_destroy ] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: verify_stopped: Checking for active resources before exit cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: 10 pending LRM operations at shutdown cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: msg_first:12 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: IPaddr_10_0_0_59:2813 cibmon[15210]: 2007/09/19_15:42:23 ERROR: cl_log: 59 messages were dropped crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: vmstat-mon:14 cibmon[15210]: 2007/09/19_15:42:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: msg_last:2815 cibmon[15210]: 2007/09/19_15:42:23 info: log_cib_diff: cib_update: Diff: --- 0.2.3877 crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: share-drbd:16 cibmon[15210]: 2007/09/19_15:42:23 info: log_cib_diff: cib_update: Diff: +++ 0.2.3878 crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: share-drbdlinks:20 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: mysql:2814 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: share-FS:18 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: share-drbdlinks:2812 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: ghash_print_pending: Pending action: IPaddr_10_0_0_59:22 cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource msg_first was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 WARN: msg_to_op(1173): failed to get the value of field lrm_opstatus from a ha_msg cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: msg_to_op: Message follows: cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 13 fields cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [lrm_t=op] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [lrm_rid=msg_last] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [lrm_op=monitor] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [lrm_timeout=15000] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[4] : [lrm_interval=0] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[5] : [lrm_delay=0] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[6] : [lrm_targetrc=-1] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[7] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[8] : [lrm_userdata=16:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[9] : [(2)lrm_param=0x82699d0(99 120)] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 4 fields cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [CRM_meta_op_target_rc=7] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [1=last] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [CRM_meta_timeout=15000] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [crm_feature_set=1.0.9] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[10] : [lrm_callid=2815] cibmon[15210]: 2007/09/19_15:42:23 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[11] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 ERROR: cl_log: 30 messages were dropped crmd[15216]: 2007/09/19_15:42:32 info: MSG[12] : [lrm_callid=2815] cibmon[15210]: 2007/09/19_15:42:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource msg_last was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3879 crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource vmstat-mon was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3880 crmd[15216]: 2007/09/19_15:42:32 WARN: msg_to_op(1173): failed to get the value of field lrm_opstatus from a ha_msg cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: msg_to_op: Message follows: cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 13 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [lrm_t=op] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [lrm_rid=IPaddr_10_0_0_59] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [lrm_op=monitor] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [lrm_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[4] : [lrm_interval=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[5] : [lrm_delay=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[6] : [lrm_targetrc=-1] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[7] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[8] : [lrm_userdata=14:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[9] : [(2)lrm_param=0x8204dc8(81 97)] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 3 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [ip=10.0.0.59] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [CRM_meta_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [crm_feature_set=1.0.9] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[10] : [lrm_callid=2813] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[11] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[12] : [lrm_callid=2813] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource IPaddr_10_0_0_59 was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource share-drbd was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource share-FS was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 WARN: msg_to_op(1173): failed to get the value of field lrm_opstatus from a ha_msg cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: msg_to_op: Message follows: cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 13 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [lrm_t=op] cibmon[15210]: 2007/09/19_15:42:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [lrm_rid=mysql] cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3880 crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [lrm_op=monitor] cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3881 crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [lrm_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[4] : [lrm_interval=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[5] : [lrm_delay=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[6] : [lrm_targetrc=-1] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[7] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[8] : [lrm_userdata=15:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[9] : [(2)lrm_param=0x828bc90(68 78)] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 2 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [CRM_meta_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [crm_feature_set=1.0.9] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[10] : [lrm_callid=2814] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[11] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[12] : [lrm_callid=2814] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource mysql was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 WARN: msg_to_op(1173): failed to get the value of field lrm_opstatus from a ha_msg cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: msg_to_op: Message follows: cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 13 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [lrm_t=op] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [lrm_rid=share-drbdlinks] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [lrm_op=monitor] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [lrm_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[4] : [lrm_interval=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[5] : [lrm_delay=0] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[6] : [lrm_targetrc=-1] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[7] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + crmd[15216]: 2007/09/19_15:42:32 info: MSG[8] : [lrm_userdata=13:126:cdefb5a2-efb8-49af-83f0-5a7f0e624015] cibmon[15210]: 2007/09/19_15:42:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[15216]: 2007/09/19_15:42:32 info: MSG[9] : [(2)lrm_param=0x81f5110(109 131)] cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3881 crmd[15216]: 2007/09/19_15:42:32 info: MSG: Dumping message with 4 fields cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3882 crmd[15216]: 2007/09/19_15:42:32 info: MSG[0] : [1=--config] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[1] : [2=/etc/drbdlinks.d/share.conf] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[2] : [CRM_meta_timeout=15000] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[3] : [crm_feature_set=1.0.9] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[10] : [lrm_callid=2812] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[11] : [lrm_app=crmd] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: MSG[12] : [lrm_callid=2812] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: verify_stopped: Resource share-drbdlinks was active at shutdown. You may ignore this error if it is unmanaged. cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: do_exit: Performing A_EXIT_1 - forcefully exiting the CRMd cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 ERROR: do_exit: Could not recover from internal error cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - crmd[15216]: 2007/09/19_15:42:32 info: do_exit: [crmd] stopped (2) cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: --- 0.2.3882 cibmon[15210]: 2007/09/19_15:42:24 info: log_cib_diff: cib_update: Diff: +++ 0.2.3883 cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:24 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3883 cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3884 cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3884 cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3885 cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 ERROR: cl_log: 1 messages were dropped cibmon[15210]: 2007/09/19_15:42:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: --- 0.2.3885 cibmon[15210]: 2007/09/19_15:42:25 info: log_cib_diff: cib_update: Diff: +++ 0.2.3886 cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:25 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 ERROR: cl_log: 30 messages were dropped cibmon[15210]: 2007/09/19_15:42:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3887 cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3888 cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3888 cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3889 cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3889 cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3890 cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: --- 0.2.3890 cibmon[15210]: 2007/09/19_15:42:26 info: log_cib_diff: cib_update: Diff: +++ 0.2.3891 cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: - cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + cibmon[15210]: 2007/09/19_15:42:26 info: log_data_element: cib_update: + heartbeat[19446]: 2007/09/19_15:44:07 info: No log entry found in ha.cf -- use logd heartbeat[19446]: 2007/09/19_15:44:07 info: Enabling logging daemon heartbeat[19446]: 2007/09/19_15:44:07 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[19446]: 2007/09/19_15:44:07 info: ************************** heartbeat[19446]: 2007/09/19_15:44:07 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[19447]: 2007/09/19_15:44:07 info: heartbeat: version 2.1.2 heartbeat[19447]: 2007/09/19_15:44:07 info: Heartbeat generation: 1188360846 heartbeat[19447]: 2007/09/19_15:44:07 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[19447]: 2007/09/19_15:44:07 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[19447]: 2007/09/19_15:44:07 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[19447]: 2007/09/19_15:44:07 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[19447]: 2007/09/19_15:44:07 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[19447]: 2007/09/19_15:44:07 info: glib: ping group heartbeat started. heartbeat[19447]: 2007/09/19_15:44:07 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[19447]: 2007/09/19_15:44:07 info: Local status now set to: 'up' heartbeat[19447]: 2007/09/19_15:44:08 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[19447]: 2007/09/19_15:44:09 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[19447]: 2007/09/19_15:44:09 info: Link local:local up. heartbeat[19447]: 2007/09/19_15:44:09 info: Status update for node local: status ping heartbeat[19447]: 2007/09/19_15:44:09 info: Status update for node host-2.awale.qc.ca: status up heartbeat[19447]: 2007/09/19_15:44:09 info: Status update for node host-2.awale.qc.ca: status active heartbeat[19447]: 2007/09/19_15:44:09 info: Comm_now_up(): updating status to active heartbeat[19447]: 2007/09/19_15:44:09 info: Local status now set to: 'active' heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[19458]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 19458) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[19447]: 2007/09/19_15:44:09 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[19447]: 2007/09/19_15:44:09 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 60 ms (> 50 ms) (GSource: 0x87c51e8) heartbeat[19459]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 19459) heartbeat[19460]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 19460) heartbeat[19461]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 19461) cibmon[19458]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[15213]: 2007/09/19_15:44:09 info: lrmd is shutting down lrmd[19461]: 2007/09/19_15:44:09 info: Signal sent to pid=15213, waiting for process to exit lrmd[19461]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[19462]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 19462) heartbeat[19463]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 19463) heartbeat[19465]: 2007/09/19_15:44:09 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 19465) cib[19460]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[19460]: 2007/09/19_15:44:09 info: G_main_add_TriggerHandler: Added signal manual handler cib[19460]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[19460]: 2007/09/19_15:44:09 info: main: Retrieval of a per-action CIB: disabled cib[19460]: 2007/09/19_15:44:09 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[19460]: 2007/09/19_15:44:09 WARN: validate_cib_digest: No on-disk digest present cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] stonithd[19462]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[19462]: 2007/09/19_15:44:09 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:09 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] ccm[19459]: 2007/09/19_15:44:10 info: Hostname: host-1.awale.qc.ca cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] stonithd[19462]: 2007/09/19_15:44:10 info: Signing in with heartbeat. heartbeat[19464]: 2007/09/19_15:44:10 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 19464) cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: log_data_element: readCibXmlFile: [on-disk] cib[19460]: 2007/09/19_15:44:10 info: startCib: CIB Initialization completed successfully cib[19460]: 2007/09/19_15:44:10 info: cib_register_ha: Signing in with Heartbeat crmd[19464]: 2007/09/19_15:44:10 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[19464]: 2007/09/19_15:44:10 info: crmd_init: Starting crmd crmd[19464]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[19464]: 2007/09/19_15:44:10 info: G_main_add_TriggerHandler: Added signal manual handler stonithd[19462]: 2007/09/19_15:44:10 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[19462]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 17 crmd[19464]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[19460]: 2007/09/19_15:44:10 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[19460]: 2007/09/19_15:44:10 WARN: cib_init: CCM Activation failed cib[19460]: 2007/09/19_15:44:10 WARN: cib_init: CCM Connection failed 1 times (30 max) lrmd[19461]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[19461]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[19461]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[19461]: 2007/09/19_15:44:10 info: Started. mgmtd[19465]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[19465]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[19465]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[19465]: 2007/09/19_15:44:10 info: init_crm attrd[19463]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[19463]: 2007/09/19_15:44:10 info: register_with_ha: Hostname: host-1.awale.qc.ca ccm[19459]: 2007/09/19_15:44:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[19463]: 2007/09/19_15:44:10 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[19460]: 2007/09/19_15:44:11 info: cib_init: Starting cib mainloop cib[19466]: 2007/09/19_15:44:11 WARN: validate_cib_digest: No on-disk digest present cibmon[19458]: 2007/09/19_15:44:11 info: main: Starting mainloop crmd[19464]: 2007/09/19_15:44:11 info: do_cib_control: CIB connection established cib[19460]: 2007/09/19_15:44:11 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[19460]: 2007/09/19_15:44:11 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[19460]: 2007/09/19_15:44:11 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] crmd[19464]: 2007/09/19_15:44:11 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[19460]: 2007/09/19_15:44:11 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[19466]: 2007/09/19_15:44:11 info: write_cib_contents: Wrote version 0.2.1 of the CIB to disk (digest: 7e9395b3ef11758d72865d506ea17d4d) cib[19460]: 2007/09/19_15:44:11 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[19460]: 2007/09/19_15:44:11 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[19464]: 2007/09/19_15:44:11 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[19464]: 2007/09/19_15:44:11 info: populate_cib_nodes: Requesting the list of configured nodes heartbeat[19447]: 2007/09/19_15:44:12 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [44:46] heartbeat[19447]: 2007/09/19_15:44:12 info: No pkts missing from host-2.awale.qc.ca! heartbeat[19447]: 2007/09/19_15:44:13 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [49:51] crmd[19464]: 2007/09/19_15:44:13 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) heartbeat[19447]: 2007/09/19_15:44:13 info: No pkts missing from host-2.awale.qc.ca! crmd[19464]: 2007/09/19_15:44:13 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[19464]: 2007/09/19_15:44:13 info: do_ha_control: Connected to Heartbeat crmd[19464]: 2007/09/19_15:44:13 info: do_ccm_control: CCM connection established... waiting for first callback crmd[19464]: 2007/09/19_15:44:13 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[19464]: 2007/09/19_15:44:13 info: crmd_init: Starting crmd's mainloop crmd[19464]: 2007/09/19_15:44:13 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[19464]: 2007/09/19_15:44:13 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[19458]: 2007/09/19_15:44:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:44:13 info: log_cib_diff: cib_update: Local-only Change: 0.2.1 cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:44:13 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[19458]: 2007/09/19_15:44:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:44:13 info: log_cib_diff: cib_update: Local-only Change: 0.2.1 cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:13 info: log_data_element: cib_update: + mgmtd[19465]: 2007/09/19_15:44:13 info: Started. crmd[19464]: 2007/09/19_15:44:14 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cib[19460]: 2007/09/19_15:44:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[19460]: 2007/09/19_15:44:14 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[19460]: 2007/09/19_15:44:14 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:44:14 info: do_started: Delaying start, CCM (0000000000100000) not connected cib[19460]: 2007/09/19_15:44:14 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[19464]: 2007/09/19_15:44:14 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[19464]: 2007/09/19_15:44:14 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[19464]: 2007/09/19_15:44:14 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[19464]: 2007/09/19_15:44:14 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) crmd[19464]: 2007/09/19_15:44:14 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 crmd[19464]: 2007/09/19_15:44:14 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=1] crmd[19464]: 2007/09/19_15:44:14 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=2] crmd[19464]: 2007/09/19_15:44:14 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=1] crmd[19464]: 2007/09/19_15:44:14 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=2] crmd[19464]: 2007/09/19_15:44:14 info: do_started: The local CRM is operational crmd[19464]: 2007/09/19_15:44:14 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[19464]: 2007/09/19_15:44:14 info: update_dc: Set DC to () cibmon[19458]: 2007/09/19_15:44:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:44:14 info: log_cib_diff: cib_update: Local-only Change: 0.2.1 cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:44:14 info: log_data_element: cib_update: + attrd[19463]: 2007/09/19_15:44:16 info: main: Starting mainloop... crmd[19464]: 2007/09/19_15:46:15 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[19464]: 2007/09/19_15:46:15 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[19464]: 2007/09/19_15:46:15 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[19464]: 2007/09/19_15:46:15 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:15 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[19464]: 2007/09/19_15:46:15 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_15:46:15 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[19464]: 2007/09/19_15:46:16 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:46:16 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:16 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[19464]: 2007/09/19_15:46:16 info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[19464]: 2007/09/19_15:46:16 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:16 info: do_dc_release: DC role released crmd[19464]: 2007/09/19_15:46:17 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:46:17 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:18 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cib[19460]: 2007/09/19_15:46:18 WARN: cib_process_diff: Diff 0.1.56 -> 0.1.57 not applied to 0.2.1: current "epoch" is greater than required cib[19460]: 2007/09/19_15:46:18 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed cib[19460]: 2007/09/19_15:46:18 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed cib[19460]: 2007/09/19_15:46:19 info: sync_our_cib: Syncing CIB to all peers crmd[19464]: 2007/09/19_15:46:21 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[19464]: 2007/09/19_15:46:21 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] crmd[19464]: 2007/09/19_15:46:21 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:46:21 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:21 info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[19464]: 2007/09/19_15:46:21 info: update_dc: Set DC to () cibmon[19458]: 2007/09/19_15:46:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.1 cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.2 cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.2 cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.3 cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.3 cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.4 cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.4 cibmon[19458]: 2007/09/19_15:46:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.5 cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:21 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:23 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[19458]: 2007/09/19_15:46:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.5 cibmon[19458]: 2007/09/19_15:46:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.6 cibmon[19458]: 2007/09/19_15:46:23 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:23 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:24 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[19464]: 2007/09/19_15:46:24 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cibmon[19458]: 2007/09/19_15:46:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.6 cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.7 cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.7 cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.8 cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.8 cibmon[19458]: 2007/09/19_15:46:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.9 cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:24 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.9 cibmon[19458]: 2007/09/19_15:46:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.10 cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=12:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.10 cibmon[19458]: 2007/09/19_15:46:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.11 cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:25 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.11 cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.12 cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=13:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.12 cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.13 cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.13 cibmon[19458]: 2007/09/19_15:46:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.14 cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:26 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=14:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=15:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=16:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=17:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=mysqld_monitor_0 key=18:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=19:0:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:26 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=0) complete crmd[19464]: 2007/09/19_15:46:26 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=0) complete crmd[19464]: 2007/09/19_15:46:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[19464]: 2007/09/19_15:46:26 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=0) complete crmd[19464]: 2007/09/19_15:46:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=0) complete crmd[19464]: 2007/09/19_15:46:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=0) complete crmd[19464]: 2007/09/19_15:46:27 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.14 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.15 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.15 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.16 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.16 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.17 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.17 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.18 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.18 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.19 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.19 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.20 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.20 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.21 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.21 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.22 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.22 cibmon[19458]: 2007/09/19_15:46:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.23 cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:27 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:27 info: process_lrm_event: LRM operation mysqld_monitor_0 (call=8, rc=7) complete crmd[19464]: 2007/09/19_15:46:28 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=4:1:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.23 cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.24 cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.24 cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.25 cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.25 cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.26 cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.26 cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.27 cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.27 cibmon[19458]: 2007/09/19_15:46:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.28 cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + msg[19640][19661]: 2007/09/19_15:46:28 INFO Starting to switch to this node. cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:28 info: log_data_element: cib_apply_diff: + msg[19640][19662]: 2007/09/19_15:46:28 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:46:29 info: process_lrm_event: LRM operation msg_first_start_0 (call=10, rc=0) complete crmd[19464]: 2007/09/19_15:46:29 info: build_operation_update: Digest for 0:0;4:1:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[19464]: 2007/09/19_15:46:29 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:29 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=5:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.28 cibmon[19458]: 2007/09/19_15:46:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.29 cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:30 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.29 cibmon[19458]: 2007/09/19_15:46:30 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.30 cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:30 info: log_data_element: cib_apply_diff: + msg[19672][19693]: 2007/09/19_15:46:30 INFO Starting to switch to this node. msg[19672][19694]: 2007/09/19_15:46:30 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:46:30 info: process_lrm_event: LRM operation msg_first_start_0 (call=11, rc=0) complete crmd[19464]: 2007/09/19_15:46:30 info: build_operation_update: Digest for 0:0;5:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[19464]: 2007/09/19_15:46:30 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:31 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=6:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:31 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=8:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.30 cibmon[19458]: 2007/09/19_15:46:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.31 cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:31 info: log_data_element: cib_apply_diff: + daemontools[19705][19728]: 2007/09/19_15:46:31 ERROR vmstat-mon already running crmd[19464]: 2007/09/19_15:46:31 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=13, rc=0) complete crmd[19464]: 2007/09/19_15:46:31 info: build_operation_update: Digest for 0:0;8:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[19464]: 2007/09/19_15:46:31 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:31 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=12, rc=0) complete crmd[19464]: 2007/09/19_15:46:33 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=9:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:33 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=11:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.31 cibmon[19458]: 2007/09/19_15:46:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.32 cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.32 cibmon[19458]: 2007/09/19_15:46:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.33 cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:33 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:33 info: process_lrm_event: LRM operation share-drbd_start_0 (call=15, rc=0) complete crmd[19464]: 2007/09/19_15:46:33 info: build_operation_update: Digest for 0:0;11:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[19464]: 2007/09/19_15:46:33 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:33 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=14, rc=0) complete crmd[19464]: 2007/09/19_15:46:34 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=12:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:34 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=14:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.33 cibmon[19458]: 2007/09/19_15:46:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.34 cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.34 cibmon[19458]: 2007/09/19_15:46:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.35 cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:34 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:34 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=16, rc=0) complete Filesystem[19743][19775]: 2007/09/19_15:46:35 INFO: Running start for /dev/drbd0 on /share Filesystem[19743][19779]: 2007/09/19_15:46:35 INFO: Filesystem /share is already mounted. crmd[19464]: 2007/09/19_15:46:35 info: process_lrm_event: LRM operation share-FS_start_0 (call=17, rc=0) complete crmd[19464]: 2007/09/19_15:46:35 info: build_operation_update: Digest for 0:0;14:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[19464]: 2007/09/19_15:46:35 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:36 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=15:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=17:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.35 cibmon[19458]: 2007/09/19_15:46:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.36 cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.36 cibmon[19458]: 2007/09/19_15:46:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.37 cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:36 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:36 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=19, rc=0) complete crmd[19464]: 2007/09/19_15:46:36 info: build_operation_update: Digest for 0:0;17:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[19464]: 2007/09/19_15:46:36 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:36 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=18, rc=0) complete crmd[19464]: 2007/09/19_15:46:37 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=18:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:37 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=20:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.37 cibmon[19458]: 2007/09/19_15:46:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.38 cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.38 cibmon[19458]: 2007/09/19_15:46:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.39 cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:37 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=20, rc=0) complete IPaddr[19822][19854]: 2007/09/19_15:46:37 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[19822][19859]: 2007/09/19_15:46:37 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 crmd[19464]: 2007/09/19_15:46:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=21, rc=0) complete crmd[19464]: 2007/09/19_15:46:37 info: build_operation_update: Digest for 0:0;20:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[19464]: 2007/09/19_15:46:37 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:39 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=21:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:39 info: do_lrm_rsc_op: Performing op=mysqld_start_0 key=22:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed lrmd[19891]: 2007/09/19_15:46:39 WARN: For LSB init script, no additional parameters are needed. cibmon[19458]: 2007/09/19_15:46:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.39 cibmon[19458]: 2007/09/19_15:46:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.40 cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.40 cibmon[19458]: 2007/09/19_15:46:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.41 cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:39 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:39 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=0) complete lrmd[19461]: 2007/09/19_15:46:40 info: RA output: (mysqld:start:stdout) Starting MySQL: lrmd[19461]: 2007/09/19_15:46:40 info: RA output: (mysqld:start:stdout) [ OK lrmd[19461]: 2007/09/19_15:46:40 info: RA output: (mysqld:start:stdout) ] lrmd[19461]: 2007/09/19_15:46:40 info: RA output: (mysqld:start:stdout) crmd[19464]: 2007/09/19_15:46:40 info: process_lrm_event: LRM operation mysqld_start_0 (call=23, rc=0) complete crmd[19464]: 2007/09/19_15:46:40 info: build_operation_update: Digest for 0:0;22:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (mysqld_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[19464]: 2007/09/19_15:46:40 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:41 info: do_lrm_rsc_op: Performing op=mysqld_monitor_120000 key=23:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) crmd[19464]: 2007/09/19_15:46:41 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=24:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.41 cibmon[19458]: 2007/09/19_15:46:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.42 cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.42 cibmon[19458]: 2007/09/19_15:46:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.43 cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:41 info: log_data_element: cib_apply_diff: + msg[20014][20036]: 2007/09/19_15:46:41 INFO Completed switching to this node. msg[20014][20038]: 2007/09/19_15:46:41 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:46:41 info: process_lrm_event: LRM operation msg_last_start_0 (call=25, rc=0) complete crmd[19464]: 2007/09/19_15:46:41 info: build_operation_update: Digest for 0:0;24:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[19464]: 2007/09/19_15:46:41 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:46:41 info: process_lrm_event: LRM operation mysqld_monitor_120000 (call=24, rc=0) complete crmd[19464]: 2007/09/19_15:46:43 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=25:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d) cibmon[19458]: 2007/09/19_15:46:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.43 cibmon[19458]: 2007/09/19_15:46:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.44 cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.44 cibmon[19458]: 2007/09/19_15:46:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.45 cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:43 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:43 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=26, rc=0) complete cibmon[19458]: 2007/09/19_15:46:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.45 cibmon[19458]: 2007/09/19_15:46:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.46 cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:45 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[19458]: 2007/09/19_15:46:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.2.46 cibmon[19458]: 2007/09/19_15:46:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.2.47 cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: - cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: + cibmon[19458]: 2007/09/19_15:46:59 info: log_data_element: cib_apply_diff: + crmd[19464]: 2007/09/19_15:46:59 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] crmd[19464]: 2007/09/19_15:46:59 info: crmd_client_status_callback: Got client status callback - our DC is dead crmd[19464]: 2007/09/19_15:46:59 info: do_state_transition: State transition S_NOT_DC -> S_ELECTION [ input=I_ELECTION cause=C_CRMD_STATUS_CALLBACK origin=crmd_client_status_callback ] cib[19460]: 2007/09/19_15:46:59 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:46:59 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:46:59 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[19464]: 2007/09/19_15:46:59 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_15:46:59 info: do_election_check: Still waiting on 1 non-votes (2 total) cib[19460]: 2007/09/19_15:47:00 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[19464]: 2007/09/19_15:47:00 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm cib[19460]: 2007/09/19_15:47:00 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm crmd[19464]: 2007/09/19_15:47:00 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[19460]: 2007/09/19_15:47:00 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[19464]: 2007/09/19_15:47:00 info: crmd_ccm_msg_callback: Quorum lost after event=NOT PRIMARY (id=2) cib[19460]: 2007/09/19_15:47:11 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[19460]: 2007/09/19_15:47:11 info: mem_handle_event: no mbr_track info crmd[19464]: 2007/09/19_15:47:11 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[19460]: 2007/09/19_15:47:11 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[19464]: 2007/09/19_15:47:11 info: mem_handle_event: no mbr_track info cib[19460]: 2007/09/19_15:47:11 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[19464]: 2007/09/19_15:47:11 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm ccm[19459]: 2007/09/19_15:47:11 info: Break tie for 2 nodes cluster cib[19460]: 2007/09/19_15:47:11 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[19464]: 2007/09/19_15:47:11 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[19460]: 2007/09/19_15:47:11 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:47:11 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=3) crmd[19464]: 2007/09/19_15:47:11 info: ccm_event_detail: NEW MEMBERSHIP: trans=3, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cibmon[19458]: 2007/09/19_15:47:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[19464]: 2007/09/19_15:47:11 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=3] cibmon[19458]: 2007/09/19_15:47:11 info: log_cib_diff: cib_update: Local-only Change: 0.2.47 crmd[19464]: 2007/09/19_15:47:11 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=1] cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:11 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:11 info: start_subsystem: Starting sub-system "tengine" cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:11 info: start_subsystem: Starting sub-system "pengine" cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:11 info: do_dc_takeover: Taking over DC status for this partition cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:11 info: update_dc: Set DC to () cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:47:11 info: join_make_offer: Making join offers based on membership 3 cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:47:11 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:47:11 info: cib_process_readwrite: We are now in R/W mode tengine[20203]: 2007/09/19_15:47:11 info: G_main_add_SignalHandler: Added signal handler for signal 15 cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:47:11 info: G_main_add_TriggerHandler: Added signal manual handler cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:47:11 info: log_cib_diff: cib_update: Diff: --- 0.2.47 cibmon[19458]: 2007/09/19_15:47:11 info: log_cib_diff: cib_update: Diff: +++ 0.2.48 cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:11 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:47:11 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[20203]: 2007/09/19_15:47:11 info: te_init: Registering TE UUID: 61183608-7fd1-4015-bbed-a40892e2138c tengine[20203]: 2007/09/19_15:47:11 info: set_graph_functions: Setting custom graph functions tengine[20203]: 2007/09/19_15:47:11 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[20203]: 2007/09/19_15:47:11 info: te_init: Starting tengine pengine[20204]: 2007/09/19_15:47:11 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[20204]: 2007/09/19_15:47:11 info: pe_init: Starting pengine crmd[19464]: 2007/09/19_15:47:11 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) cib[19460]: 2007/09/19_15:47:12 info: sync_our_cib: Syncing CIB to all peers crmd[19464]: 2007/09/19_15:47:12 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[19464]: 2007/09/19_15:47:12 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[19464]: 2007/09/19_15:47:12 info: update_attrd: Connecting to attrd... attrd[19463]: 2007/09/19_15:47:12 info: attrd_local_callback: Sending full refresh cibmon[19458]: 2007/09/19_15:47:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:47:12 info: log_cib_diff: cib_update: Diff: --- 0.2.48 cibmon[19458]: 2007/09/19_15:47:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.49 cibmon[19458]: 2007/09/19_15:47:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:47:12 info: log_cib_diff: cib_update: Diff: --- 0.2.49 cibmon[19458]: 2007/09/19_15:47:12 info: log_cib_diff: cib_update: Diff: +++ 0.2.50 cibmon[19458]: 2007/09/19_15:47:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:12 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:47:13 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;5:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;24:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;8:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;20:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;11:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;14:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;22:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (mysqld_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: build_operation_update: Digest for 0:0;17:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[19464]: 2007/09/19_15:47:13 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:47:13 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:47:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:47:13 info: process_graph_event: Action msg_first_monitor_0 initiated by a different transitioner cibmon[19458]: 2007/09/19_15:47:13 info: log_cib_diff: cib_update: Diff: --- 0.2.50 tengine[20203]: 2007/09/19_15:47:13 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:47:13 info: log_cib_diff: cib_update: Diff: +++ 0.2.51 tengine[20203]: 2007/09/19_15:47:13 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:47:13 info: process_graph_event: Action msg_last_monitor_0 initiated by a different transitioner cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:47:13 info: process_graph_event: Action mysqld_monitor_0 initiated by a different transitioner cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:13 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:47:13 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:13 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_15:47:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:47:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:47:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:47:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:47:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:47:13 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:47:13 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:47:13 info: group_print: Resource Group: group-DW crmd[19464]: 2007/09/19_15:47:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:47:13 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:47:13 info: unpack_graph: Unpacked transition 0: 0 actions in 0 synapses pengine[20204]: 2007/09/19_15:47:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:47:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:47:13 info: run_graph: Transition 0: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[20204]: 2007/09/19_15:47:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:47:13 info: notify_crmd: Transition 0 status: te_complete - pengine[20204]: 2007/09/19_15:47:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:13 info: native_print: mysqld (lsb:mysqld): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:13 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource mysqld (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:13 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-36.bz2 heartbeat[19447]: 2007/09/19_15:47:30 WARN: node host-2.awale.qc.ca: is dead heartbeat[19447]: 2007/09/19_15:47:30 info: Link host-2.awale.qc.ca:eth0 dead. crmd[19464]: 2007/09/19_15:47:30 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] cibmon[19458]: 2007/09/19_15:47:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[19464]: 2007/09/19_15:47:30 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:47:30 info: te_update_diff: Aborting on transient_attributes deletions cibmon[19458]: 2007/09/19_15:47:30 info: log_cib_diff: cib_update: Local-only Change: 0.2.51 crmd[19464]: 2007/09/19_15:47:30 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_15:47:30 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:47:30 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_15:47:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:47:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:47:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:47:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:47:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:47:30 notice: unpack_config: On loss of CCM Quorum: Ignore crmd[19464]: 2007/09/19_15:47:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:47:30 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[20203]: 2007/09/19_15:47:30 info: unpack_graph: Unpacked transition 1: 0 actions in 0 synapses pengine[20204]: 2007/09/19_15:47:30 info: group_print: Resource Group: group-DW tengine[20203]: 2007/09/19_15:47:30 info: run_graph: Transition 1: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[20204]: 2007/09/19_15:47:30 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:47:30 info: notify_crmd: Transition 1 status: te_complete - pengine[20204]: 2007/09/19_15:47:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: mysqld (lsb:mysqld): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:47:30 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:47:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource mysqld (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:47:30 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-37.bz2 heartbeat[19447]: 2007/09/19_15:48:53 info: Heartbeat restart on node host-2.awale.qc.ca heartbeat[19447]: 2007/09/19_15:48:53 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[19447]: 2007/09/19_15:48:53 info: Status update for node host-2.awale.qc.ca: status init heartbeat[19447]: 2007/09/19_15:48:53 info: Status update for node host-2.awale.qc.ca: status up crmd[19464]: 2007/09/19_15:48:53 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] crmd[19464]: 2007/09/19_15:48:53 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[19447]: 2007/09/19_15:48:54 info: Status update for node host-2.awale.qc.ca: status active crmd[19464]: 2007/09/19_15:48:54 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] cibmon[19458]: 2007/09/19_15:48:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:48:54 info: log_cib_diff: cib_update: Local-only Change: 0.2.51 cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:54 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:48:55 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[19447]: 2007/09/19_15:48:57 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [12:14] heartbeat[19447]: 2007/09/19_15:48:57 info: No pkts missing from host-2.awale.qc.ca! crmd[19464]: 2007/09/19_15:48:57 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[19458]: 2007/09/19_15:48:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:48:58 info: log_cib_diff: cib_update: Local-only Change: 0.2.51 cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:58 info: log_data_element: cib_update: + heartbeat[19447]: 2007/09/19_15:48:58 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [17:19] heartbeat[19447]: 2007/09/19_15:48:58 info: No pkts missing from host-2.awale.qc.ca! cib[19460]: 2007/09/19_15:48:59 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[19464]: 2007/09/19_15:48:59 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[19460]: 2007/09/19_15:48:59 info: mem_handle_event: no mbr_track info crmd[19464]: 2007/09/19_15:48:59 info: mem_handle_event: no mbr_track info crmd[19464]: 2007/09/19_15:48:59 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[19464]: 2007/09/19_15:48:59 info: mem_handle_event: instance=4, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[19464]: 2007/09/19_15:48:59 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=4) crmd[19464]: 2007/09/19_15:48:59 info: ccm_event_detail: NEW MEMBERSHIP: trans=4, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[19464]: 2007/09/19_15:48:59 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=2] crmd[19464]: 2007/09/19_15:48:59 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=4] crmd[19464]: 2007/09/19_15:48:59 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=4] cibmon[19458]: 2007/09/19_15:48:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:48:59 info: log_cib_diff: cib_update: Local-only Change: 0.2.51 cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_15:48:59 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_15:48:59 info: mem_handle_event: instance=4, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_15:48:59 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_15:48:59 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:48:59 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:02 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[19464]: 2007/09/19_15:49:02 info: update_dc: Set DC to () crmd[19464]: 2007/09/19_15:49:02 info: join_make_offer: Making join offers based on membership 4 tengine[20203]: 2007/09/19_15:49:02 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[19464]: 2007/09/19_15:49:02 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks crmd[19464]: 2007/09/19_15:49:02 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) cib[19460]: 2007/09/19_15:49:03 info: sync_our_cib: Syncing CIB to all peers crmd[19464]: 2007/09/19_15:49:03 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] attrd[19463]: 2007/09/19_15:49:03 info: attrd_local_callback: Sending full refresh crmd[19464]: 2007/09/19_15:49:03 info: do_state_transition: All 2 cluster nodes responded to the join offer. cibmon[19458]: 2007/09/19_15:49:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: --- 0.2.51 cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.52 cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: --- 0.2.52 cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.53 cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: --- 0.2.53 cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.54 cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:04 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;5:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;24:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;8:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;20:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;11:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;14:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;22:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (mysqld_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: build_operation_update: Digest for 0:0;17:2:2834f9eb-c59a-4d07-9d09-9ea9389f800d (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[19464]: 2007/09/19_15:49:04 info: log_data_element: build_operation_update: digest:source crmd[19464]: 2007/09/19_15:49:04 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: --- 0.2.54 cibmon[19458]: 2007/09/19_15:49:04 info: log_cib_diff: cib_update: Diff: +++ 0.2.55 cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:04 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:04 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:05 info: log_cib_diff: cib_update: Diff: --- 0.2.55 cibmon[19458]: 2007/09/19_15:49:05 info: log_cib_diff: cib_update: Diff: +++ 0.2.56 cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:49:05 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:49:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:05 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_15:49:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:49:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:49:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:49:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:49:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:49:05 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:49:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:05 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:05 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_15:49:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: mysqld (lsb:mysqld): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_15:49:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource mysqld (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:05 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) tengine[20203]: 2007/09/19_15:49:05 info: unpack_graph: Unpacked transition 2: 10 actions in 10 synapses pengine[20204]: 2007/09/19_15:49:05 info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-38.bz2 tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 11: msg_first_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 13: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 14: share-FS_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 15: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 17: mysqld_monitor_0 on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:05 info: send_rsc_command: Initiating action 18: msg_last_monitor_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:06 info: match_graph_event: Action share-drbd_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: --- 0.2.56 cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.57 cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:06 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: --- 0.2.57 cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.58 cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: --- 0.2.58 cibmon[19458]: 2007/09/19_15:49:06 info: log_cib_diff: cib_update: Diff: +++ 0.2.59 cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:06 info: match_graph_event: Action msg_first_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:06 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:07 info: match_graph_event: Action share-FS_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:07 info: log_cib_diff: cib_update: Diff: --- 0.2.59 cibmon[19458]: 2007/09/19_15:49:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.60 cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:07 info: log_cib_diff: cib_update: Diff: --- 0.2.60 cibmon[19458]: 2007/09/19_15:49:07 info: log_cib_diff: cib_update: Diff: +++ 0.2.61 cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:07 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[20203]: 2007/09/19_15:49:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: --- 0.2.61 cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.62 cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:08 info: match_graph_event: Action msg_last_monitor_0 (18) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: --- 0.2.62 cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.63 cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:08 info: match_graph_event: Action mysqld_monitor_0 (17) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:08 info: send_rsc_command: Initiating action 10: probe_complete on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:08 info: te_pseudo_action: Pseudo action 9 fired and confirmed cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:08 info: run_graph: Transition 2: (Complete=10, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:49:08 info: notify_crmd: Transition 2 status: te_complete - cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: --- 0.2.63 cibmon[19458]: 2007/09/19_15:49:08 info: log_cib_diff: cib_update: Diff: +++ 0.2.64 cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:08 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:09 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[19458]: 2007/09/19_15:49:09 info: log_cib_diff: cib_modify: Diff: --- 0.2.64 tengine[20203]: 2007/09/19_15:49:09 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[19458]: 2007/09/19_15:49:09 info: log_cib_diff: cib_modify: Diff: +++ 0.2.65 crmd[19464]: 2007/09/19_15:49:09 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:49:09 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: - crmd[19464]: 2007/09/19_15:49:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + pengine[20204]: 2007/09/19_15:49:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + crmd[19464]: 2007/09/19_15:49:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:49:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + pengine[20204]: 2007/09/19_15:49:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + pengine[20204]: 2007/09/19_15:49:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + pengine[20204]: 2007/09/19_15:49:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[19458]: 2007/09/19_15:49:09 info: log_data_element: cib_modify: + pengine[20204]: 2007/09/19_15:49:09 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:49:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:09 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_15:49:09 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: mysqld (lsb:mysqld): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:09 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:49:09 info: unpack_graph: Unpacked transition 3: 0 actions in 0 synapses pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_15:49:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:49:09 info: run_graph: Transition 3: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[20203]: 2007/09/19_15:49:09 info: notify_crmd: Transition 3 status: te_complete - pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource mysqld (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:09 info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-39.bz2 cibmon[19458]: 2007/09/19_15:49:45 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_delete: Diff: --- 0.2.65 cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_delete: Diff: +++ 0.2.66 cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:49:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_update: Diff: --- 0.2.66 cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_update: Diff: +++ 0.3.1 crmd[19464]: 2007/09/19_15:49:45 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:49:45 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_15:49:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:49:45 info: log_data_element: cib:diff: + pengine[20204]: 2007/09/19_15:49:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:49:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:49:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:49:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:49:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:49:45 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:49:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_15:49:45 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_15:49:45 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: mysqld (lsb:mysqld): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource share-drbd (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource share-FS (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource share-drbdlinks (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource mysqld (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop mysqld pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start mysqld pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca mysqld_monitor_120000 pengine[20204]: 2007/09/19_15:49:45 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_15:49:45 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[20204]: 2007/09/19_15:49:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[20204]: 2007/09/19_15:49:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 cib[20776]: 2007/09/19_15:49:45 info: write_cib_contents: Wrote version 0.3.1 of the CIB to disk (digest: a9291485cea4aa418015b0946f2c8179) crmd[19464]: 2007/09/19_15:49:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:49:45 info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-40.bz2 tengine[20203]: 2007/09/19_15:49:45 info: unpack_graph: Unpacked transition 4: 28 actions in 28 synapses tengine[20203]: 2007/09/19_15:49:45 info: te_pseudo_action: Pseudo action 38 fired and confirmed tengine[20203]: 2007/09/19_15:49:45 info: send_rsc_command: Initiating action 33: msg_last_stop_0 on host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:49:45 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=33:4:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_15:49:45 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=26, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:45 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_delete: Diff: --- 0.3.1 cibmon[19458]: 2007/09/19_15:49:45 info: log_cib_diff: cib_delete: Diff: +++ 0.3.2 cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:45 info: log_data_element: cib_delete: + msg[20777][20798]: 2007/09/19_15:49:45 INFO Starting to switch away from this node. msg[20777][20799]: 2007/09/19_15:49:45 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:49:46 info: process_lrm_event: LRM operation msg_last_stop_0 (call=27, rc=0) complete cibmon[19458]: 2007/09/19_15:49:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:46 info: log_cib_diff: cib_update: Diff: --- 0.3.2 cibmon[19458]: 2007/09/19_15:49:46 info: log_cib_diff: cib_update: Diff: +++ 0.3.3 cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:46 info: match_graph_event: Action msg_last_stop_0 (33) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:46 info: send_rsc_command: Initiating action 30: mysqld_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:46 info: do_lrm_rsc_op: Performing op=mysqld_stop_0 key=30:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_update: + lrmd[20809]: 2007/09/19_15:49:46 WARN: For LSB init script, no additional parameters are needed. crmd[19464]: 2007/09/19_15:49:46 info: process_lrm_event: LRM operation mysqld_monitor_120000 (call=24, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:46 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:46 info: log_cib_diff: cib_delete: Diff: --- 0.3.3 cibmon[19458]: 2007/09/19_15:49:46 info: log_cib_diff: cib_delete: Diff: +++ 0.3.4 cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:46 info: log_data_element: cib_delete: + lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) Stopping MySQL: lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) [ lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) OK lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) ] lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (mysqld:stop:stdout) crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation mysqld_stop_0 (call=28, rc=0) complete cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: --- 0.3.4 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: +++ 0.3.5 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:48 info: match_graph_event: Action mysqld_stop_0 (30) confirmed on host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:49:48 info: send_rsc_command: Initiating action 27: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:49:48 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=27:4:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=22, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: --- 0.3.5 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: +++ 0.3.6 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: + lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[19461]: 2007/09/19_15:49:48 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[20893][20908]: 2007/09/19_15:49:48 INFO: ifconfig eth0:0 down crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=29, rc=0) complete cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: --- 0.3.6 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: +++ 0.3.7 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:48 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (27) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:48 info: send_rsc_command: Initiating action 24: share-drbdlinks_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=24:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=20, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: --- 0.3.7 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: +++ 0.3.8 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: + crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=30, rc=0) complete tengine[20203]: 2007/09/19_15:49:48 info: match_graph_event: Action share-drbdlinks_stop_0 (24) confirmed on host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:49:48 info: send_rsc_command: Initiating action 21: share-FS_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: --- 0.3.8 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_update: Diff: +++ 0.3.9 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:48 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=21:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:48 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=18, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:48 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: --- 0.3.9 cibmon[19458]: 2007/09/19_15:49:48 info: log_cib_diff: cib_delete: Diff: +++ 0.3.10 cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:48 info: log_data_element: cib_delete: + Filesystem[20915][20944]: 2007/09/19_15:49:49 INFO: Running stop for /dev/drbd0 on /share Filesystem[20915][20954]: 2007/09/19_15:49:49 INFO: Trying to unmount /share Filesystem[20915][20956]: 2007/09/19_15:49:49 INFO: unmounted /share successfully crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation share-FS_stop_0 (call=31, rc=0) complete cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:49 info: match_graph_event: Action share-FS_stop_0 (21) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: --- 0.3.10 tengine[20203]: 2007/09/19_15:49:49 info: send_rsc_command: Initiating action 18: share-drbd_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: +++ 0.3.11 cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: do_lrm_rsc_op: Performing op=share-drbd_stop_0 key=18:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=16, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: --- 0.3.11 cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: +++ 0.3.12 cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: + crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation share-drbd_stop_0 (call=32, rc=0) complete cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: --- 0.3.12 cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: +++ 0.3.13 tengine[20203]: 2007/09/19_15:49:49 info: match_graph_event: Action share-drbd_stop_0 (18) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:49 info: send_rsc_command: Initiating action 15: vmstat-mon_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=15:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=14, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: --- 0.3.13 cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: +++ 0.3.14 cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: + daemontools[20964][20973]: 2007/09/19_15:49:49 INFO Stoping vmstat-mon crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=33, rc=0) complete cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:49 info: match_graph_event: Action vmstat-mon_stop_0 (15) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: --- 0.3.14 tengine[20203]: 2007/09/19_15:49:49 info: send_rsc_command: Initiating action 12: msg_first_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: +++ 0.3.15 cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=12:4:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=12, rc=-2) Cancelled cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: --- 0.3.15 cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_delete: Diff: +++ 0.3.16 cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_delete: + msg[20976][20997]: 2007/09/19_15:49:49 INFO Completed switching away from this node. msg[20976][20998]: 2007/09/19_15:49:49 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:49:49 info: process_lrm_event: LRM operation msg_first_stop_0 (call=34, rc=0) complete cibmon[19458]: 2007/09/19_15:49:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: --- 0.3.16 cibmon[19458]: 2007/09/19_15:49:49 info: log_cib_diff: cib_update: Diff: +++ 0.3.17 tengine[20203]: 2007/09/19_15:49:49 info: match_graph_event: Action msg_first_stop_0 (12) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:49 info: te_pseudo_action: Pseudo action 39 fired and confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:49 info: te_pseudo_action: Pseudo action 36 fired and confirmed cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:49 info: send_rsc_command: Initiating action 13: msg_first_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:49 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:51 info: match_graph_event: Action msg_first_start_0 (13) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:51 info: log_cib_diff: cib_update: Diff: --- 0.3.17 tengine[20203]: 2007/09/19_15:49:51 info: send_rsc_command: Initiating action 14: msg_first_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:51 info: log_cib_diff: cib_update: Diff: +++ 0.3.18 tengine[20203]: 2007/09/19_15:49:51 info: send_rsc_command: Initiating action 16: vmstat-mon_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:52 info: match_graph_event: Action msg_first_monitor_120000 (14) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:52 info: log_cib_diff: cib_update: Diff: --- 0.3.18 cibmon[19458]: 2007/09/19_15:49:52 info: log_cib_diff: cib_update: Diff: +++ 0.3.19 cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:52 info: match_graph_event: Action vmstat-mon_start_0 (16) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:52 info: send_rsc_command: Initiating action 17: vmstat-mon_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:52 info: send_rsc_command: Initiating action 19: share-drbd_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:52 info: log_cib_diff: cib_update: Diff: --- 0.3.19 cibmon[19458]: 2007/09/19_15:49:52 info: log_cib_diff: cib_update: Diff: +++ 0.3.20 cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:55 info: log_cib_diff: cib_update: Diff: --- 0.3.20 cibmon[19458]: 2007/09/19_15:49:55 info: log_cib_diff: cib_update: Diff: +++ 0.3.21 tengine[20203]: 2007/09/19_15:49:55 info: match_graph_event: Action share-drbd_start_0 (19) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:55 info: send_rsc_command: Initiating action 20: share-drbd_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:55 info: send_rsc_command: Initiating action 22: share-FS_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:55 info: match_graph_event: Action vmstat-mon_monitor_120000 (17) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:55 info: log_cib_diff: cib_update: Diff: --- 0.3.21 cibmon[19458]: 2007/09/19_15:49:55 info: log_cib_diff: cib_update: Diff: +++ 0.3.22 cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:56 info: log_cib_diff: cib_update: Diff: --- 0.3.22 tengine[20203]: 2007/09/19_15:49:56 info: match_graph_event: Action share-drbd_monitor_120000 (20) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:56 info: log_cib_diff: cib_update: Diff: +++ 0.3.23 cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:56 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:57 info: log_cib_diff: cib_update: Diff: --- 0.3.23 cibmon[19458]: 2007/09/19_15:49:57 info: log_cib_diff: cib_update: Diff: +++ 0.3.24 tengine[20203]: 2007/09/19_15:49:57 info: match_graph_event: Action share-FS_start_0 (22) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:49:57 info: send_rsc_command: Initiating action 23: share-FS_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:49:57 info: send_rsc_command: Initiating action 25: share-drbdlinks_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:49:58 info: match_graph_event: Action share-drbdlinks_start_0 (25) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:58 info: log_cib_diff: cib_update: Diff: --- 0.3.24 tengine[20203]: 2007/09/19_15:49:58 info: send_rsc_command: Initiating action 26: share-drbdlinks_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:58 info: log_cib_diff: cib_update: Diff: +++ 0.3.25 tengine[20203]: 2007/09/19_15:49:58 info: send_rsc_command: Initiating action 28: IPaddr_10_0_0_59_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:49:58 info: log_cib_diff: cib_update: Diff: --- 0.3.25 cibmon[19458]: 2007/09/19_15:49:58 info: log_cib_diff: cib_update: Diff: +++ 0.3.26 tengine[20203]: 2007/09/19_15:49:58 info: match_graph_event: Action share-FS_monitor_120000 (23) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:49:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:01 info: match_graph_event: Action share-drbdlinks_monitor_120000 (26) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:01 info: log_cib_diff: cib_update: Diff: --- 0.3.26 cibmon[19458]: 2007/09/19_15:50:01 info: log_cib_diff: cib_update: Diff: +++ 0.3.27 cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:01 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (28) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:01 info: send_rsc_command: Initiating action 29: IPaddr_10_0_0_59_monitor_5000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:01 info: send_rsc_command: Initiating action 31: mysqld_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:01 info: log_cib_diff: cib_update: Diff: --- 0.3.27 cibmon[19458]: 2007/09/19_15:50:01 info: log_cib_diff: cib_update: Diff: +++ 0.3.28 cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:03 info: log_cib_diff: cib_update: Diff: --- 0.3.28 cibmon[19458]: 2007/09/19_15:50:03 info: log_cib_diff: cib_update: Diff: +++ 0.3.29 tengine[20203]: 2007/09/19_15:50:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (29) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:03 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:04 info: log_cib_diff: cib_update: Diff: --- 0.3.29 tengine[20203]: 2007/09/19_15:50:04 info: match_graph_event: Action mysqld_start_0 (31) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:04 info: log_cib_diff: cib_update: Diff: +++ 0.3.30 tengine[20203]: 2007/09/19_15:50:04 info: send_rsc_command: Initiating action 32: mysqld_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:04 info: send_rsc_command: Initiating action 34: msg_last_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:07 info: log_cib_diff: cib_update: Diff: --- 0.3.30 cibmon[19458]: 2007/09/19_15:50:07 info: log_cib_diff: cib_update: Diff: +++ 0.3.31 cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:07 info: match_graph_event: Action msg_last_start_0 (34) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:07 info: te_pseudo_action: Pseudo action 37 fired and confirmed cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:07 info: send_rsc_command: Initiating action 35: msg_last_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:07 info: log_cib_diff: cib_update: Diff: --- 0.3.31 cibmon[19458]: 2007/09/19_15:50:07 info: log_cib_diff: cib_update: Diff: +++ 0.3.32 cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:07 info: match_graph_event: Action mysqld_monitor_120000 (32) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:07 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:09 info: log_cib_diff: cib_update: Diff: --- 0.3.32 cibmon[19458]: 2007/09/19_15:50:09 info: log_cib_diff: cib_update: Diff: +++ 0.3.33 tengine[20203]: 2007/09/19_15:50:09 info: match_graph_event: Action msg_last_monitor_120000 (35) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:50:09 info: run_graph: Transition 4: (Complete=28, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:09 info: notify_crmd: Transition 4 status: te_complete - cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:09 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:40 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:40 info: log_cib_diff: cib_delete: Diff: --- 0.3.33 cibmon[19458]: 2007/09/19_15:50:40 info: log_cib_diff: cib_delete: Diff: +++ 0.4.1 tengine[20203]: 2007/09/19_15:50:40 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - crmd[19464]: 2007/09/19_15:50:40 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_15:50:40 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: + cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: - cib[19460]: 2007/09/19_15:50:40 info: log_data_element: cib:diff: + pengine[20204]: 2007/09/19_15:50:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:50:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:50:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:50:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:50:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:50:40 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:50:40 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:50:40 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_15:50:40 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_15:50:40 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[20204]: 2007/09/19_15:50:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[20204]: 2007/09/19_15:50:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[20204]: 2007/09/19_15:50:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:40 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed pengine[20204]: 2007/09/19_15:50:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:40 info: log_cib_diff: cib_delete: Diff: --- 0.4.1 pengine[20204]: 2007/09/19_15:50:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:40 info: log_cib_diff: cib_delete: Diff: +++ 0.4.2 pengine[20204]: 2007/09/19_15:50:40 info: native_print: mysqld (lsb:mysqld): Started host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: - pengine[20204]: 2007/09/19_15:50:40 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:40 info: log_data_element: cib_delete: + pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource msg_first (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource vmstat-mon (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop vmstat-mon pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource share-drbd (host-2.awale.qc.ca -> host-1.awale.qc.ca) cib[21013]: 2007/09/19_15:50:40 info: write_cib_contents: Wrote version 0.4.1 of the CIB to disk (digest: 36d673dcd4a4dfb9d8496c27c3e3537e) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource share-FS (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop share-FS pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource share-drbdlinks (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop share-drbdlinks pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource mysqld (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop mysqld pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start mysqld pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca mysqld_monitor_120000 pengine[20204]: 2007/09/19_15:50:40 notice: NoRoleChange: Move resource msg_last (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:50:40 notice: StopRsc: host-2.awale.qc.ca Stop msg_last pengine[20204]: 2007/09/19_15:50:40 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[20204]: 2007/09/19_15:50:40 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 crmd[19464]: 2007/09/19_15:50:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:50:40 info: process_pe_message: Transition 5: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-41.bz2 tengine[20203]: 2007/09/19_15:50:40 info: unpack_graph: Unpacked transition 5: 28 actions in 28 synapses tengine[20203]: 2007/09/19_15:50:40 info: te_pseudo_action: Pseudo action 38 fired and confirmed tengine[20203]: 2007/09/19_15:50:40 info: send_rsc_command: Initiating action 33: msg_last_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:41 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:41 info: log_cib_diff: cib_delete: Diff: --- 0.4.2 cibmon[19458]: 2007/09/19_15:50:41 info: log_cib_diff: cib_delete: Diff: +++ 0.4.3 cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: - tengine[20203]: 2007/09/19_15:50:41 info: match_graph_event: Action msg_last_stop_0 (33) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_delete: + tengine[20203]: 2007/09/19_15:50:41 info: send_rsc_command: Initiating action 30: mysqld_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:41 info: log_cib_diff: cib_update: Diff: --- 0.4.3 cibmon[19458]: 2007/09/19_15:50:41 info: log_cib_diff: cib_update: Diff: +++ 0.4.4 cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:41 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:42 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:42 info: log_cib_diff: cib_delete: Diff: --- 0.4.4 cibmon[19458]: 2007/09/19_15:50:42 info: log_cib_diff: cib_delete: Diff: +++ 0.4.5 cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:42 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:46 info: match_graph_event: Action mysqld_stop_0 (30) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:46 info: log_cib_diff: cib_update: Diff: --- 0.4.5 tengine[20203]: 2007/09/19_15:50:46 info: send_rsc_command: Initiating action 27: IPaddr_10_0_0_59_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:46 info: log_cib_diff: cib_update: Diff: +++ 0.4.6 cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:48 info: log_cib_diff: cib_delete: Diff: --- 0.4.6 cibmon[19458]: 2007/09/19_15:50:48 info: log_cib_diff: cib_delete: Diff: +++ 0.4.7 cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:48 info: log_cib_diff: cib_update: Diff: --- 0.4.7 cibmon[19458]: 2007/09/19_15:50:48 info: log_cib_diff: cib_update: Diff: +++ 0.4.8 tengine[20203]: 2007/09/19_15:50:48 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (27) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:48 info: send_rsc_command: Initiating action 24: share-drbdlinks_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:48 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:50 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:50 info: log_cib_diff: cib_delete: Diff: --- 0.4.8 cibmon[19458]: 2007/09/19_15:50:50 info: log_cib_diff: cib_delete: Diff: +++ 0.4.9 cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:50 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:51 info: log_cib_diff: cib_update: Diff: --- 0.4.9 tengine[20203]: 2007/09/19_15:50:51 info: match_graph_event: Action share-drbdlinks_stop_0 (24) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:51 info: log_cib_diff: cib_update: Diff: +++ 0.4.10 tengine[20203]: 2007/09/19_15:50:51 info: send_rsc_command: Initiating action 21: share-FS_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:51 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:51 info: log_cib_diff: cib_delete: Diff: --- 0.4.10 cibmon[19458]: 2007/09/19_15:50:51 info: log_cib_diff: cib_delete: Diff: +++ 0.4.11 cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:51 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:52 info: log_cib_diff: cib_update: Diff: --- 0.4.11 tengine[20203]: 2007/09/19_15:50:52 info: match_graph_event: Action share-FS_stop_0 (21) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:52 info: log_cib_diff: cib_update: Diff: +++ 0.4.12 tengine[20203]: 2007/09/19_15:50:52 info: send_rsc_command: Initiating action 18: share-drbd_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:52 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:53 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:53 info: log_cib_diff: cib_delete: Diff: --- 0.4.12 cibmon[19458]: 2007/09/19_15:50:53 info: log_cib_diff: cib_delete: Diff: +++ 0.4.13 cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:53 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:54 info: match_graph_event: Action share-drbd_stop_0 (18) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:54 info: log_cib_diff: cib_update: Diff: --- 0.4.13 tengine[20203]: 2007/09/19_15:50:54 info: send_rsc_command: Initiating action 15: vmstat-mon_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:54 info: log_cib_diff: cib_update: Diff: +++ 0.4.14 cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:54 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:54 info: log_cib_diff: cib_delete: Diff: --- 0.4.14 cibmon[19458]: 2007/09/19_15:50:54 info: log_cib_diff: cib_delete: Diff: +++ 0.4.15 cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:54 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:55 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:55 info: match_graph_event: Action vmstat-mon_stop_0 (15) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:55 info: log_cib_diff: cib_update: Diff: --- 0.4.15 cibmon[19458]: 2007/09/19_15:50:55 info: log_cib_diff: cib_update: Diff: +++ 0.4.16 tengine[20203]: 2007/09/19_15:50:55 info: send_rsc_command: Initiating action 12: msg_first_stop_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:55 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:56 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:50:56 info: log_cib_diff: cib_delete: Diff: --- 0.4.16 cibmon[19458]: 2007/09/19_15:50:56 info: log_cib_diff: cib_delete: Diff: +++ 0.4.17 cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:50:56 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.17 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.18 tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action msg_first_stop_0 (12) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: te_pseudo_action: Pseudo action 39 fired and confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:57 info: te_pseudo_action: Pseudo action 36 fired and confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=13:5:61183608-7fd1-4015-bbed-a40892e2138c) tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 13: msg_first_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + msg[21015][21036]: 2007/09/19_15:50:57 INFO Starting to switch to this node. msg[21015][21037]: 2007/09/19_15:50:57 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation msg_first_start_0 (call=35, rc=0) complete crmd[19464]: 2007/09/19_15:50:57 info: build_operation_update: Digest for 0:0;13:5:61183608-7fd1-4015-bbed-a40892e2138c (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[19464]: 2007/09/19_15:50:57 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.18 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.19 cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action msg_first_start_0 (13) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 14: msg_first_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 16: vmstat-mon_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=14:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=16:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + daemontools[21048][21068]: 2007/09/19_15:50:57 INFO Starting vmstat-mon crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=36, rc=0) complete cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.19 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.20 cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=37, rc=0) complete cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: build_operation_update: Digest for 0:0;16:5:61183608-7fd1-4015-bbed-a40892e2138c (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action msg_first_monitor_120000 (14) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.20 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.21 tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action vmstat-mon_start_0 (16) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 17: vmstat-mon_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 19: share-drbd_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=17:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=19:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation share-drbd_start_0 (call=39, rc=0) complete crmd[19464]: 2007/09/19_15:50:57 info: build_operation_update: Digest for 0:0;19:5:61183608-7fd1-4015-bbed-a40892e2138c (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[19464]: 2007/09/19_15:50:57 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.21 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.22 tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action share-drbd_start_0 (19) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 20: share-drbd_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:50:57 info: send_rsc_command: Initiating action 22: share-FS_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=20:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=22:5:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=38, rc=0) complete cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.22 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.23 cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action vmstat-mon_monitor_120000 (17) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:57 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=40, rc=0) complete cibmon[19458]: 2007/09/19_15:50:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:57 info: match_graph_event: Action share-drbd_monitor_120000 (20) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: --- 0.4.23 cibmon[19458]: 2007/09/19_15:50:57 info: log_cib_diff: cib_update: Diff: +++ 0.4.24 cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:57 info: log_data_element: cib_update: + Filesystem[21091][21126]: 2007/09/19_15:50:57 INFO: Running start for /dev/drbd0 on /share crmd[19464]: 2007/09/19_15:50:58 info: process_lrm_event: LRM operation share-FS_start_0 (call=41, rc=0) complete crmd[19464]: 2007/09/19_15:50:58 info: build_operation_update: Digest for 0:0;22:5:61183608-7fd1-4015-bbed-a40892e2138c (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[19464]: 2007/09/19_15:50:58 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:58 info: match_graph_event: Action share-FS_start_0 (22) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: --- 0.4.24 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 23: share-FS_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: +++ 0.4.25 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 25: share-drbdlinks_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=23:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=25:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:58 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=43, rc=0) complete crmd[19464]: 2007/09/19_15:50:58 info: build_operation_update: Digest for 0:0;25:5:61183608-7fd1-4015-bbed-a40892e2138c (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[19464]: 2007/09/19_15:50:58 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:58 info: match_graph_event: Action share-drbdlinks_start_0 (25) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: --- 0.4.25 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 26: share-drbdlinks_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: +++ 0.4.26 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 28: IPaddr_10_0_0_59_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=26:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=28:5:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_15:50:58 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=44, rc=0) complete cibmon[19458]: 2007/09/19_15:50:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: --- 0.4.26 cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: +++ 0.4.27 tengine[20203]: 2007/09/19_15:50:58 info: match_graph_event: Action share-drbdlinks_monitor_120000 (26) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:50:58 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=42, rc=0) complete cibmon[19458]: 2007/09/19_15:50:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:58 info: match_graph_event: Action share-FS_monitor_120000 (23) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: --- 0.4.27 cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: +++ 0.4.28 cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + IPaddr[21176][21208]: 2007/09/19_15:50:58 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[21176][21213]: 2007/09/19_15:50:58 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[21176][21235]: 2007/09/19_15:50:58 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[19464]: 2007/09/19_15:50:58 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=45, rc=0) complete crmd[19464]: 2007/09/19_15:50:58 info: build_operation_update: Digest for 0:0;28:5:61183608-7fd1-4015-bbed-a40892e2138c (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[19464]: 2007/09/19_15:50:58 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:50:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_15:50:58 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (28) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: --- 0.4.28 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 29: IPaddr_10_0_0_59_monitor_5000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_cib_diff: cib_update: Diff: +++ 0.4.29 tengine[20203]: 2007/09/19_15:50:58 info: send_rsc_command: Initiating action 31: mysqld_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=29:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:50:58 info: do_lrm_rsc_op: Performing op=mysqld_start_0 key=31:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:58 info: log_data_element: cib_update: + lrmd[21255]: 2007/09/19_15:50:58 WARN: For LSB init script, no additional parameters are needed. crmd[19464]: 2007/09/19_15:50:59 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=46, rc=0) complete cibmon[19458]: 2007/09/19_15:50:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:50:59 info: log_cib_diff: cib_update: Diff: --- 0.4.29 cibmon[19458]: 2007/09/19_15:50:59 info: log_cib_diff: cib_update: Diff: +++ 0.4.30 cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:50:59 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (29) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:50:59 info: log_data_element: cib_update: + lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) Starting MySQL: lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) [ lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) OK lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) ] lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) lrmd[19461]: 2007/09/19_15:51:00 info: RA output: (mysqld:start:stdout) crmd[19464]: 2007/09/19_15:51:00 info: process_lrm_event: LRM operation mysqld_start_0 (call=47, rc=0) complete crmd[19464]: 2007/09/19_15:51:00 info: build_operation_update: Digest for 0:0;31:5:61183608-7fd1-4015-bbed-a40892e2138c (mysqld_start_0) was f2317cad3d54cec5d7d7aa7d0bf35cf8 crmd[19464]: 2007/09/19_15:51:00 info: log_data_element: build_operation_update: digest:source tengine[20203]: 2007/09/19_15:51:00 info: match_graph_event: Action mysqld_start_0 (31) confirmed on host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:51:00 info: send_rsc_command: Initiating action 32: mysqld_monitor_120000 on host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:51:00 info: do_lrm_rsc_op: Performing op=mysqld_monitor_120000 key=32:5:61183608-7fd1-4015-bbed-a40892e2138c) tengine[20203]: 2007/09/19_15:51:00 info: send_rsc_command: Initiating action 34: msg_last_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:51:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: --- 0.4.30 cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: +++ 0.4.31 cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:51:00 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=34:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + msg[21376][21420]: 2007/09/19_15:51:00 INFO Completed switching to this node. msg[21376][21424]: 2007/09/19_15:51:00 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_15:51:00 info: process_lrm_event: LRM operation mysqld_monitor_120000 (call=48, rc=0) complete cibmon[19458]: 2007/09/19_15:51:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: --- 0.4.31 cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: +++ 0.4.32 tengine[20203]: 2007/09/19_15:51:00 info: match_graph_event: Action mysqld_monitor_120000 (32) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:51:00 info: process_lrm_event: LRM operation msg_last_start_0 (call=49, rc=0) complete cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:51:00 info: build_operation_update: Digest for 0:0;34:5:61183608-7fd1-4015-bbed-a40892e2138c (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:51:00 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:51:00 info: match_graph_event: Action msg_last_start_0 (34) confirmed on host-1.awale.qc.ca tengine[20203]: 2007/09/19_15:51:00 info: te_pseudo_action: Pseudo action 37 fired and confirmed tengine[20203]: 2007/09/19_15:51:00 info: send_rsc_command: Initiating action 35: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:51:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: --- 0.4.32 cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: +++ 0.4.33 crmd[19464]: 2007/09/19_15:51:00 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=35:5:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:51:00 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=50, rc=0) complete cibmon[19458]: 2007/09/19_15:51:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: --- 0.4.33 cibmon[19458]: 2007/09/19_15:51:00 info: log_cib_diff: cib_update: Diff: +++ 0.4.34 cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:51:00 info: match_graph_event: Action msg_last_monitor_120000 (35) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_15:51:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:51:00 info: run_graph: Transition 5: (Complete=28, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_15:51:00 info: notify_crmd: Transition 5 status: te_complete - cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:51:00 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_15:54:11 info: cib_stats: Processed 218 operations (7018.00us average, 0% utilization) in the last 10min cib[19460]: 2007/09/19_15:57:43 ERROR: cib_process_request: cib_query operation failed: Invalid CIB section specified cib[19460]: 2007/09/19_15:57:43 info: crm_log_message_adv: #========= Input message message start ==========# cib[19460]: 2007/09/19_15:57:43 info: MSG: Dumping message with 8 fields cib[19460]: 2007/09/19_15:57:43 info: MSG[0] : [__name__=cib_command] cib[19460]: 2007/09/19_15:57:43 info: MSG[1] : [t=cib] cib[19460]: 2007/09/19_15:57:43 info: MSG[2] : [cib_op=cib_query] cib[19460]: 2007/09/19_15:57:43 info: MSG[3] : [cib_section=mysqld] cib[19460]: 2007/09/19_15:57:43 info: MSG[4] : [cib_callid=2] cib[19460]: 2007/09/19_15:57:43 info: MSG[5] : [cib_callopt=0] cib[19460]: 2007/09/19_15:57:43 info: MSG[6] : [cib_clientid=1636431a-3c54-4733-9eab-4e9f61d56ab6] cib[19460]: 2007/09/19_15:57:43 info: MSG[7] : [cib_clientname=23004] cib[19460]: 2007/09/19_15:57:59 ERROR: cib_process_request: cib_query operation failed: Invalid CIB section specified cib[19460]: 2007/09/19_15:57:59 info: crm_log_message_adv: #========= Input message message start ==========# cib[19460]: 2007/09/19_15:57:59 info: MSG: Dumping message with 8 fields cib[19460]: 2007/09/19_15:57:59 info: MSG[0] : [__name__=cib_command] cib[19460]: 2007/09/19_15:57:59 info: MSG[1] : [t=cib] cib[19460]: 2007/09/19_15:57:59 info: MSG[2] : [cib_op=cib_query] cib[19460]: 2007/09/19_15:57:59 info: MSG[3] : [cib_section=resources/mysqld] cib[19460]: 2007/09/19_15:57:59 info: MSG[4] : [cib_callid=2] cib[19460]: 2007/09/19_15:57:59 info: MSG[5] : [cib_callopt=0] cib[19460]: 2007/09/19_15:57:59 info: MSG[6] : [cib_clientid=4f200e22-d4c5-46bd-ad0b-daf18a701600] cib[19460]: 2007/09/19_15:57:59 info: MSG[7] : [cib_clientname=23050] cibmon[19458]: 2007/09/19_15:58:39 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:58:39 info: log_cib_diff: cib_delete: Diff: --- 0.4.34 cibmon[19458]: 2007/09/19_15:58:39 info: log_cib_diff: cib_delete: Diff: +++ 0.5.1 cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_15:58:39 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:58:39 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_15:58:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: + cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: - cib[19460]: 2007/09/19_15:58:39 info: log_data_element: cib:diff: + cib[23169]: 2007/09/19_15:58:39 info: write_cib_contents: Wrote version 0.5.1 of the CIB to disk (digest: e2452b00a144a39510cd5cb6c0a50910) pengine[20204]: 2007/09/19_15:58:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_15:58:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_15:58:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_15:58:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_15:58:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_15:58:39 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_15:58:39 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource crmd[19464]: 2007/09/19_15:58:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource tengine[20203]: 2007/09/19_15:58:39 info: unpack_graph: Unpacked transition 6: 1 actions in 1 synapses pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource tengine[20203]: 2007/09/19_15:58:39 info: send_rsc_command: Initiating action 30: mysqld_stop_0 on host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource crmd[19464]: 2007/09/19_15:58:39 info: do_lrm_rsc_op: Performing op=mysqld_stop_0 key=30:6:61183608-7fd1-4015-bbed-a40892e2138c) pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_15:58:39 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_15:58:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_15:58:39 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_15:58:39 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 info: native_print: mysqld (lsb:mysqld ORPHANED): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_15:58:39 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_15:58:39 info: process_lrm_event: LRM operation mysqld_monitor_120000 (call=48, rc=-2) Cancelled pengine[20204]: 2007/09/19_15:58:39 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_15:58:39 notice: StopRsc: host-1.awale.qc.ca Stop mysqld lrmd[23171]: 2007/09/19_15:58:39 WARN: For LSB init script, no additional parameters are needed. pengine[20204]: 2007/09/19_15:58:39 info: process_pe_message: Transition 6: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-42.bz2 pengine[20204]: 2007/09/19_15:58:39 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[19458]: 2007/09/19_15:58:39 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:58:39 info: log_cib_diff: cib_delete: Diff: --- 0.5.1 cibmon[19458]: 2007/09/19_15:58:39 info: log_cib_diff: cib_delete: Diff: +++ 0.5.2 cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:39 info: log_data_element: cib_delete: + lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) Stopping MySQL: lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) [ lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) OK lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) ] lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) lrmd[19461]: 2007/09/19_15:58:42 info: RA output: (mysqld:stop:stdout) crmd[19464]: 2007/09/19_15:58:42 info: process_lrm_event: LRM operation mysqld_stop_0 (call=51, rc=0) complete cibmon[19458]: 2007/09/19_15:58:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_15:58:42 info: log_cib_diff: cib_update: Diff: --- 0.5.2 cibmon[19458]: 2007/09/19_15:58:42 info: log_cib_diff: cib_update: Diff: +++ 0.5.3 cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:58:42 info: match_graph_event: Action mysqld_stop_0 (30) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_15:58:42 info: run_graph: Transition 6: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_15:58:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_15:58:42 info: notify_crmd: Transition 6 status: te_complete - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:42 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_15:58:45 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_15:58:45 info: log_cib_diff: cib_delete: Diff: --- 0.5.3 cibmon[19458]: 2007/09/19_15:58:45 info: log_cib_diff: cib_delete: Diff: +++ 0.5.4 cibmon[19458]: 2007/09/19_15:58:45 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_15:58:45 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:03:38 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_16:03:38 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:03:38 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_create: Diff: --- 0.5.4 cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + crmd[19464]: 2007/09/19_16:03:38 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_create: Diff: +++ 0.6.1 cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: - cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[19460]: 2007/09/19_16:03:38 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_create: + cib[24332]: 2007/09/19_16:03:38 info: write_cib_contents: Wrote version 0.6.1 of the CIB to disk (digest: b97365c5415e8f7a39263b24afb4c707) pengine[20204]: 2007/09/19_16:03:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:03:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:03:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:03:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:03:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:03:38 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:03:38 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: process_orphan_resource: Orphan resource crmd[19464]: 2007/09/19_16:03:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:03:38 info: unpack_graph: Unpacked transition 7: 7 actions in 7 synapses pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: create_fake_resource: Orphan resource tengine[20203]: 2007/09/19_16:03:38 info: send_rsc_command: Initiating action 10: mysql_monitor_0 on host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: create_fake_resource: Orphan resource tengine[20203]: 2007/09/19_16:03:38 info: send_rsc_command: Initiating action 12: mysql_monitor_0 on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:03:38 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:03:38 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_16:03:38 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:03:38 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:03:38 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:03:38 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[20204]: 2007/09/19_16:03:38 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[20204]: 2007/09/19_16:03:38 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:03:38 info: process_pe_message: Transition 7: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-43.bz2 pengine[20204]: 2007/09/19_16:03:38 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[19464]: 2007/09/19_16:03:38 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=12:7:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_16:03:38 info: process_lrm_event: LRM operation mysql_monitor_0 (call=52, rc=7) complete cibmon[19458]: 2007/09/19_16:03:38 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:03:38 info: match_graph_event: Action mysql_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_update: Diff: --- 0.6.1 tengine[20203]: 2007/09/19_16:03:38 info: send_rsc_command: Initiating action 11: probe_complete on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_update: Diff: +++ 0.6.2 cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:38 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_modify: Diff: --- 0.6.2 cibmon[19458]: 2007/09/19_16:03:38 info: log_cib_diff: cib_modify: Diff: +++ 0.6.3 cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_modify: - cibmon[19458]: 2007/09/19_16:03:38 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_16:03:39 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:03:39 info: match_graph_event: Action mysql_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:39 info: log_cib_diff: cib_update: Diff: --- 0.6.3 tengine[20203]: 2007/09/19_16:03:39 info: send_rsc_command: Initiating action 9: probe_complete on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:39 info: log_cib_diff: cib_update: Diff: +++ 0.6.4 tengine[20203]: 2007/09/19_16:03:39 info: te_pseudo_action: Pseudo action 8 fired and confirmed cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:03:39 info: send_rsc_command: Initiating action 31: mysql_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:39 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:40 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[19458]: 2007/09/19_16:03:40 info: log_cib_diff: cib_modify: Diff: --- 0.6.4 cibmon[19458]: 2007/09/19_16:03:40 info: log_cib_diff: cib_modify: Diff: +++ 0.6.5 cibmon[19458]: 2007/09/19_16:03:40 info: log_data_element: cib_modify: - cibmon[19458]: 2007/09/19_16:03:40 info: log_data_element: cib_modify: + cibmon[19458]: 2007/09/19_16:03:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:03:44 info: match_graph_event: Action mysql_start_0 (31) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:44 info: log_cib_diff: cib_update: Diff: --- 0.6.5 tengine[20203]: 2007/09/19_16:03:44 info: send_rsc_command: Initiating action 32: mysql_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:44 info: log_cib_diff: cib_update: Diff: +++ 0.6.6 cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:44 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:03:46 info: log_cib_diff: cib_update: Diff: --- 0.6.6 tengine[20203]: 2007/09/19_16:03:46 info: match_graph_event: Action mysql_monitor_120000 (32) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:03:46 info: log_cib_diff: cib_update: Diff: +++ 0.6.7 tengine[20203]: 2007/09/19_16:03:46 info: run_graph: Transition 7: (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:03:46 info: notify_crmd: Transition 7 status: te_complete - cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:03:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:03:46 info: log_data_element: cib_update: + lrmd[19461]: 2007/09/19_16:03:56 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x8c60298) lrmd[19461]: 2007/09/19_16:03:56 info: G_SIG_dispatch: started at 430261113 should have started at 430261013 cib[19460]: 2007/09/19_16:04:11 info: cib_stats: Processed 20 operations (12500.00us average, 0% utilization) in the last 10min cibmon[19458]: 2007/09/19_16:05:02 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:02 info: log_cib_diff: cib_delete: Diff: --- 0.6.7 cibmon[19458]: 2007/09/19_16:05:02 info: log_cib_diff: cib_delete: Diff: +++ 0.6.8 cibmon[19458]: 2007/09/19_16:05:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:02 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:02 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:02 info: log_cib_diff: cib_delete: Diff: --- 0.6.8 cibmon[19458]: 2007/09/19_16:05:02 info: log_cib_diff: cib_delete: Diff: +++ 0.6.9 cibmon[19458]: 2007/09/19_16:05:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:02 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:04 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:04 info: log_cib_diff: cib_delete: Diff: --- 0.6.9 cibmon[19458]: 2007/09/19_16:05:04 info: log_cib_diff: cib_delete: Diff: +++ 0.6.10 cibmon[19458]: 2007/09/19_16:05:04 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:04 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:04 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:04 info: log_cib_diff: cib_delete: Diff: --- 0.6.10 cibmon[19458]: 2007/09/19_16:05:04 info: log_cib_diff: cib_delete: Diff: +++ 0.6.11 cibmon[19458]: 2007/09/19_16:05:04 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:04 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:48 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:48 info: log_cib_diff: cib_delete: Diff: --- 0.6.11 cibmon[19458]: 2007/09/19_16:05:48 info: log_cib_diff: cib_delete: Diff: +++ 0.6.12 cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:05:48 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:05:48 info: log_cib_diff: cib_update: Diff: --- 0.6.12 crmd[19464]: 2007/09/19_16:05:48 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[19458]: 2007/09/19_16:05:48 info: log_cib_diff: cib_update: Diff: +++ 0.7.1 cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_16:05:48 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:05:48 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:05:48 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:05:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:05:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:05:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:05:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:05:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:05:48 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:05:48 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: create_fake_resource: Orphan resource crmd[19464]: 2007/09/19_16:05:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:05:48 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:05:48 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:05:48 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[20203]: 2007/09/19_16:05:48 info: unpack_graph: Unpacked transition 8: 3 actions in 3 synapses pengine[20204]: 2007/09/19_16:05:48 info: group_print: Resource Group: group-DW tengine[20203]: 2007/09/19_16:05:48 info: send_rsc_command: Initiating action 30: mysql_stop_0 on host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:05:48 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[20204]: 2007/09/19_16:05:48 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[20204]: 2007/09/19_16:05:48 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[20204]: 2007/09/19_16:05:48 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:05:48 info: process_pe_message: Transition 8: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-44.bz2 pengine[20204]: 2007/09/19_16:05:48 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[24794]: 2007/09/19_16:05:48 info: write_cib_contents: Wrote version 0.7.1 of the CIB to disk (digest: 95787965b9036d95024fb4eba6ca7972) cibmon[19458]: 2007/09/19_16:05:49 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:05:49 info: log_cib_diff: cib_delete: Diff: --- 0.7.1 cibmon[19458]: 2007/09/19_16:05:49 info: log_cib_diff: cib_delete: Diff: +++ 0.7.2 cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:05:49 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:05:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:05:53 info: log_cib_diff: cib_update: Diff: --- 0.7.2 tengine[20203]: 2007/09/19_16:05:53 info: match_graph_event: Action mysql_stop_0 (30) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:05:53 info: log_cib_diff: cib_update: Diff: +++ 0.7.3 tengine[20203]: 2007/09/19_16:05:53 info: send_rsc_command: Initiating action 31: mysql_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:05:53 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=31:8:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:53 info: log_data_element: cib_update: + mysql[24811][24893]: 2007/09/19_16:05:58 INFO: MySQL started crmd[19464]: 2007/09/19_16:05:58 info: process_lrm_event: LRM operation mysql_start_0 (call=53, rc=0) complete crmd[19464]: 2007/09/19_16:05:58 info: build_operation_update: Digest for 0:0;31:8:61183608-7fd1-4015-bbed-a40892e2138c (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[19464]: 2007/09/19_16:05:58 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_16:05:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:05:58 info: match_graph_event: Action mysql_start_0 (31) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:05:58 info: log_cib_diff: cib_update: Diff: --- 0.7.3 tengine[20203]: 2007/09/19_16:05:58 info: send_rsc_command: Initiating action 32: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:05:58 info: log_cib_diff: cib_update: Diff: +++ 0.7.4 cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:05:58 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=32:8:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:05:58 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=54, rc=0) complete cibmon[19458]: 2007/09/19_16:05:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:05:58 info: log_cib_diff: cib_update: Diff: --- 0.7.4 tengine[20203]: 2007/09/19_16:05:58 info: match_graph_event: Action mysql_monitor_120000 (32) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:05:58 info: log_cib_diff: cib_update: Diff: +++ 0.7.5 tengine[20203]: 2007/09/19_16:05:58 info: run_graph: Transition 8: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:05:58 info: notify_crmd: Transition 8 status: te_complete - cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:05:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:05:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:24 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_delete: Diff: --- 0.7.5 cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_delete: Diff: +++ 0.7.6 cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:06:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - tengine[20203]: 2007/09/19_16:06:24 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_update: Diff: --- 0.7.6 cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_update: Diff: +++ 0.8.1 cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + crmd[19464]: 2007/09/19_16:06:24 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + crmd[19464]: 2007/09/19_16:06:24 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:06:24 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_update: + cib[24985]: 2007/09/19_16:06:24 info: write_cib_contents: Wrote version 0.8.1 of the CIB to disk (digest: 426ddafc3671b1df5a0105d668e502e5) pengine[20204]: 2007/09/19_16:06:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:06:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:06:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:06:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:06:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:06:24 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:06:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: create_fake_resource: Orphan resource crmd[19464]: 2007/09/19_16:06:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:06:24 info: log_data_element: create_fake_resource: Orphan resource tengine[20203]: 2007/09/19_16:06:24 info: unpack_graph: Unpacked transition 9: 3 actions in 3 synapses pengine[20204]: 2007/09/19_16:06:24 info: process_orphan_resource: Making sure orphan mysqld is stopped tengine[20203]: 2007/09/19_16:06:24 info: send_rsc_command: Initiating action 30: mysql_stop_0 on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_16:06:24 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:06:24 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:06:24 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=30:9:61183608-7fd1-4015-bbed-a40892e2138c) pengine[20204]: 2007/09/19_16:06:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) crmd[19464]: 2007/09/19_16:06:24 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=54, rc=-2) Cancelled pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[20204]: 2007/09/19_16:06:24 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[20204]: 2007/09/19_16:06:24 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[20204]: 2007/09/19_16:06:24 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[20204]: 2007/09/19_16:06:24 info: native_color: Stopping orphan resource mysqld cibmon[19458]: 2007/09/19_16:06:24 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_delete: Diff: --- 0.8.1 cibmon[19458]: 2007/09/19_16:06:24 info: log_cib_diff: cib_delete: Diff: +++ 0.8.2 cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:06:24 info: log_data_element: cib_delete: + pengine[20204]: 2007/09/19_16:06:24 info: process_pe_message: Transition 9: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-45.bz2 pengine[20204]: 2007/09/19_16:06:24 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. mysql[24987][25025]: 2007/09/19_16:06:28 INFO: MySQL stopped crmd[19464]: 2007/09/19_16:06:28 info: process_lrm_event: LRM operation mysql_stop_0 (call=55, rc=0) complete cibmon[19458]: 2007/09/19_16:06:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:06:28 info: log_cib_diff: cib_update: Diff: --- 0.8.2 cibmon[19458]: 2007/09/19_16:06:28 info: log_cib_diff: cib_update: Diff: +++ 0.8.3 tengine[20203]: 2007/09/19_16:06:28 info: match_graph_event: Action mysql_stop_0 (30) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:06:28 info: send_rsc_command: Initiating action 31: mysql_start_0 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:06:33 info: match_graph_event: Action mysql_start_0 (31) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:06:33 info: log_cib_diff: cib_update: Diff: --- 0.8.3 tengine[20203]: 2007/09/19_16:06:33 info: send_rsc_command: Initiating action 32: mysql_monitor_120000 on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:06:33 info: log_cib_diff: cib_update: Diff: +++ 0.8.4 cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:33 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[19464]: 2007/09/19_16:06:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:06:35 info: match_graph_event: Action mysql_monitor_120000 (32) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:06:35 info: log_cib_diff: cib_update: Diff: --- 0.8.4 tengine[20203]: 2007/09/19_16:06:35 info: run_graph: Transition 9: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_16:06:35 info: log_cib_diff: cib_update: Diff: +++ 0.8.5 tengine[20203]: 2007/09/19_16:06:35 info: notify_crmd: Transition 9 status: te_complete - cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:06:35 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:07:06 info: log_cib_diff: cib_delete: Diff: --- 0.8.5 cibmon[19458]: 2007/09/19_16:07:06 info: log_cib_diff: cib_delete: Diff: +++ 0.8.6 cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:07:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[19464]: 2007/09/19_16:07:06 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:07:06 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:07:06 info: log_cib_diff: cib_update: Diff: --- 0.8.6 cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - crmd[19464]: 2007/09/19_16:07:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_16:07:06 info: log_cib_diff: cib_update: Diff: +++ 0.9.1 cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: - cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: - cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:06 info: log_data_element: cib:diff: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:06 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:07:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:07:06 info: unpack_graph: Unpacked transition 10: 3 actions in 3 synapses pengine[20204]: 2007/09/19_16:07:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[20203]: 2007/09/19_16:07:06 info: send_rsc_command: Initiating action 30: mysql_stop_0 on host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:07:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:07:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:07:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:07:06 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:07:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:06 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:07:06 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[20204]: 2007/09/19_16:07:06 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:07:06 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) cib[25232]: 2007/09/19_16:07:06 info: write_cib_contents: Wrote version 0.9.1 of the CIB to disk (digest: fa6adfc66233e363e53f0fa970dc3c4c) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:06 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[20204]: 2007/09/19_16:07:06 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[20204]: 2007/09/19_16:07:06 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[20204]: 2007/09/19_16:07:06 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:07:06 info: process_pe_message: Transition 10: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-46.bz2 pengine[20204]: 2007/09/19_16:07:06 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[19458]: 2007/09/19_16:07:07 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:07:07 info: log_cib_diff: cib_delete: Diff: --- 0.9.1 cibmon[19458]: 2007/09/19_16:07:07 info: log_cib_diff: cib_delete: Diff: +++ 0.9.2 cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:07:07 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:07:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:07:12 info: log_cib_diff: cib_update: Diff: --- 0.9.2 cibmon[19458]: 2007/09/19_16:07:12 info: log_cib_diff: cib_update: Diff: +++ 0.9.3 cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:07:12 info: match_graph_event: Action mysql_stop_0 (30) confirmed on host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:07:12 info: send_rsc_command: Initiating action 31: mysql_start_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:07:12 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=31:10:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:12 info: log_data_element: cib_update: + mysql[25250][25330]: 2007/09/19_16:07:16 INFO: MySQL started crmd[19464]: 2007/09/19_16:07:16 info: process_lrm_event: LRM operation mysql_start_0 (call=56, rc=0) complete crmd[19464]: 2007/09/19_16:07:16 info: build_operation_update: Digest for 0:0;31:10:61183608-7fd1-4015-bbed-a40892e2138c (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[19464]: 2007/09/19_16:07:16 info: log_data_element: build_operation_update: digest:source cibmon[19458]: 2007/09/19_16:07:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:07:16 info: match_graph_event: Action mysql_start_0 (31) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:16 info: log_cib_diff: cib_update: Diff: --- 0.9.3 tengine[20203]: 2007/09/19_16:07:16 info: send_rsc_command: Initiating action 32: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:16 info: log_cib_diff: cib_update: Diff: +++ 0.9.4 cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:07:16 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=32:10:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:07:16 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=57, rc=0) complete cibmon[19458]: 2007/09/19_16:07:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:07:16 info: match_graph_event: Action mysql_monitor_120000 (32) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:16 info: log_cib_diff: cib_update: Diff: --- 0.9.4 crmd[19464]: 2007/09/19_16:07:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:07:16 info: run_graph: Transition 10: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_16:07:16 info: log_cib_diff: cib_update: Diff: +++ 0.9.5 tengine[20203]: 2007/09/19_16:07:16 info: notify_crmd: Transition 10 status: te_complete - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:16 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:07:28 info: handle_shutdown_request: Creating shutdown request for host-2.awale.qc.ca cibmon[19458]: 2007/09/19_16:07:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:07:28 info: log_cib_diff: cib_update: Diff: --- 0.9.5 cibmon[19458]: 2007/09/19_16:07:28 info: log_cib_diff: cib_update: Diff: +++ 0.9.6 tengine[20203]: 2007/09/19_16:07:28 info: extract_event: Aborting on shutdown attribute for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:07:28 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:07:28 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:07:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:28 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:07:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:07:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:07:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:07:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:07:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:07:28 notice: unpack_config: On loss of CCM Quorum: Ignore crmd[19464]: 2007/09/19_16:07:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:07:28 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[20203]: 2007/09/19_16:07:28 info: unpack_graph: Unpacked transition 11: 1 actions in 1 synapses pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: process_orphan_resource: Orphan resource tengine[20203]: 2007/09/19_16:07:28 info: te_crm_command: Executing crm-event (32): do_shutdown on host-2.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:07:28 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:07:28 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:07:28 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:07:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:07:28 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:07:28 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[20204]: 2007/09/19_16:07:28 info: process_pe_message: Transition 11: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-47.bz2 pengine[20204]: 2007/09/19_16:07:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[19460]: 2007/09/19_16:07:29 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca crmd[19464]: 2007/09/19_16:07:29 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] cibmon[19458]: 2007/09/19_16:07:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:07:29 info: log_cib_diff: cib_update: Local-only Change: 0.9.6 cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:07:29 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[19464]: 2007/09/19_16:07:29 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[19464]: 2007/09/19_16:07:29 info: mem_handle_event: no mbr_track info cib[19460]: 2007/09/19_16:07:29 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[19464]: 2007/09/19_16:07:29 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[19460]: 2007/09/19_16:07:29 info: mem_handle_event: no mbr_track info crmd[19464]: 2007/09/19_16:07:29 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[19460]: 2007/09/19_16:07:29 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[19464]: 2007/09/19_16:07:29 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=5) ccm[19459]: 2007/09/19_16:07:29 info: Break tie for 2 nodes cluster cib[19460]: 2007/09/19_16:07:29 info: mem_handle_event: instance=5, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[19464]: 2007/09/19_16:07:29 info: ccm_event_detail: NEW MEMBERSHIP: trans=5, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cib[19460]: 2007/09/19_16:07:29 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[19464]: 2007/09/19_16:07:29 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=5] cib[19460]: 2007/09/19_16:07:29 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:07:29 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=4] cibmon[19458]: 2007/09/19_16:07:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:07:29 info: log_cib_diff: cib_update: Local-only Change: 0.9.6 cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:07:29 info: run_graph: Transition 11: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:07:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:07:29 info: notify_crmd: Transition 11 status: te_complete - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:07:29 info: log_data_element: cib_update: + heartbeat[19447]: 2007/09/19_16:07:59 WARN: node host-2.awale.qc.ca: is dead crmd[19464]: 2007/09/19_16:07:59 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] heartbeat[19447]: 2007/09/19_16:07:59 info: Link host-2.awale.qc.ca:eth0 dead. cibmon[19458]: 2007/09/19_16:08:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:00 info: log_cib_diff: cib_update: Local-only Change: 0.9.6 crmd[19464]: 2007/09/19_16:08:00 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:00 info: te_update_diff: Aborting on transient_attributes deletions cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:08:00 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:00 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:00 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:08:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:00 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: create_fake_resource: Orphan resource crmd[19464]: 2007/09/19_16:08:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:00 info: unpack_graph: Unpacked transition 12: 0 actions in 0 synapses pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: create_fake_resource: Orphan resource crmd[19464]: 2007/09/19_16:08:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:00 info: run_graph: Transition 12: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: create_fake_resource: Orphan resource tengine[20203]: 2007/09/19_16:08:00 info: notify_crmd: Transition 12 status: te_complete - pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:00 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:08:00 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:08:00 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[20204]: 2007/09/19_16:08:00 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:08:00 info: process_pe_message: Transition 12: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-48.bz2 pengine[20204]: 2007/09/19_16:08:00 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[19447]: 2007/09/19_16:08:01 info: killing /usr/lib/heartbeat/mgmtd -v process group 19465 with signal 15 mgmtd[19465]: 2007/09/19_16:08:01 info: mgmtd is shutting down heartbeat[19447]: 2007/09/19_16:08:01 info: killing /usr/lib/heartbeat/crmd process group 19464 with signal 15 crmd[19464]: 2007/09/19_16:08:01 info: crm_shutdown: Requesting shutdown crmd[19464]: 2007/09/19_16:08:01 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] crmd[19464]: 2007/09/19_16:08:01 info: do_state_transition: All 1 cluster nodes are eligible to run resources. crmd[19464]: 2007/09/19_16:08:01 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:01 info: do_shutdown_req: Processing shutdown locally crmd[19464]: 2007/09/19_16:08:01 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_update: Diff: --- 0.9.6 cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_update: Diff: +++ 0.9.7 cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + tengine[20203]: 2007/09/19_16:08:01 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[20203]: 2007/09/19_16:08:01 info: update_abort_priority: Abort priority upgraded to 1000000 heartbeat[19447]: 2007/09/19_16:08:01 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 70 ms (> 30 ms) (GSource: 0x87bede8) pengine[20204]: 2007/09/19_16:08:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:01 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:01 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:01 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:08:01 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:08:01 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource msg_first cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource share-drbd cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource share-FS cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource msg_last cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[20204]: 2007/09/19_16:08:01 WARN: native_color: Resource mysql cannot run anywhere pengine[20204]: 2007/09/19_16:08:01 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[20204]: 2007/09/19_16:08:01 info: native_color: Stopping orphan resource mysqld pengine[20204]: 2007/09/19_16:08:01 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown crmd[19464]: 2007/09/19_16:08:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:01 info: unpack_graph: Unpacked transition 13: 11 actions in 11 synapses tengine[20203]: 2007/09/19_16:08:01 info: te_pseudo_action: Pseudo action 20 fired and confirmed tengine[20203]: 2007/09/19_16:08:01 info: send_rsc_command: Initiating action 17: msg_last_stop_0 on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:01 info: send_rsc_command: Initiating action 22: mysql_stop_0 on host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:01 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=17:13:61183608-7fd1-4015-bbed-a40892e2138c) crmd[19464]: 2007/09/19_16:08:01 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=22:13:61183608-7fd1-4015-bbed-a40892e2138c) pengine[20204]: 2007/09/19_16:08:01 WARN: process_pe_message: Transition 13: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-145.bz2 pengine[20204]: 2007/09/19_16:08:01 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[19464]: 2007/09/19_16:08:01 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=50, rc=-2) Cancelled crmd[19464]: 2007/09/19_16:08:01 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=57, rc=-2) Cancelled cibmon[19458]: 2007/09/19_16:08:01 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: --- 0.9.7 cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: +++ 0.9.8 cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: + cibmon[19458]: 2007/09/19_16:08:01 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: --- 0.9.8 cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: +++ 0.9.9 cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: + msg[25715][25749]: 2007/09/19_16:08:01 INFO Starting to switch away from this node. msg[25715][25750]: 2007/09/19_16:08:01 INFO Node: host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:01 info: process_lrm_event: LRM operation msg_last_stop_0 (call=58, rc=0) complete cibmon[19458]: 2007/09/19_16:08:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:08:01 info: match_graph_event: Action msg_last_stop_0 (17) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_update: Diff: --- 0.9.9 tengine[20203]: 2007/09/19_16:08:01 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_update: Diff: +++ 0.9.10 crmd[19464]: 2007/09/19_16:08:01 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=16:13:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:08:01 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=46, rc=-2) Cancelled cibmon[19458]: 2007/09/19_16:08:01 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: --- 0.9.10 cibmon[19458]: 2007/09/19_16:08:01 info: log_cib_diff: cib_delete: Diff: +++ 0.9.11 cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:01 info: log_data_element: cib_delete: + lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[25760][25775]: 2007/09/19_16:08:02 INFO: ifconfig eth0:0 down crmd[19464]: 2007/09/19_16:08:02 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=60, rc=0) complete tengine[20203]: 2007/09/19_16:08:02 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (16) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:08:02 info: send_rsc_command: Initiating action 15: share-drbdlinks_stop_0 on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_update: Diff: --- 0.9.11 cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_update: Diff: +++ 0.9.12 cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:08:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=15:13:61183608-7fd1-4015-bbed-a40892e2138c) cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:08:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=44, rc=-2) Cancelled cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_delete: Diff: --- 0.9.12 cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_delete: Diff: +++ 0.9.13 cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_delete: + lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (share-drbdlinks:stop:stderr) umount: /var/lib/mysql: device is busy lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (share-drbdlinks:stop:stderr) umount: /var/lib/mysql: device is busy lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (share-drbdlinks:stop:stderr) Error removing "/var/lib/mysql": [Errno 16] Device or resource busy: '/var/lib/mysql' lrmd[19461]: 2007/09/19_16:08:02 info: RA output: (share-drbdlinks:stop:stderr) Error renaming "/var/lib/mysql.drbdlinks" to "/var/lib/mysql": [Errno 16] Device or resource busy crmd[19464]: 2007/09/19_16:08:02 ERROR: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=61, rc=1) Error unknown error cibmon[19458]: 2007/09/19_16:08:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:08:02 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 1): Error cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_update: Diff: --- 0.9.13 tengine[20203]: 2007/09/19_16:08:02 info: update_abort_priority: Abort priority upgraded to 1 cibmon[19458]: 2007/09/19_16:08:02 info: log_cib_diff: cib_update: Diff: +++ 0.9.14 tengine[20203]: 2007/09/19_16:08:02 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:08:02 info: match_graph_event: Action share-drbdlinks_stop_0 (15) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:02 info: log_data_element: cib_update: + mysql[25716][25791]: 2007/09/19_16:08:04 INFO: MySQL stopped crmd[19464]: 2007/09/19_16:08:04 info: process_lrm_event: LRM operation mysql_stop_0 (call=59, rc=0) complete cibmon[19458]: 2007/09/19_16:08:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:08:04 info: match_graph_event: Action mysql_stop_0 (22) confirmed on host-1.awale.qc.ca cibmon[19458]: 2007/09/19_16:08:04 info: log_cib_diff: cib_update: Diff: --- 0.9.14 crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:04 info: run_graph: ==================================================== cibmon[19458]: 2007/09/19_16:08:04 info: log_cib_diff: cib_update: Diff: +++ 0.9.15 crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:04 notice: run_graph: Transition 13: (Complete=5, Pending=0, Fired=0, Skipped=6, Incomplete=0) cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:08:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:04 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:04 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: process_orphan_resource: Orphan resource crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:08:04 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:04 info: process_orphan_resource: Making sure orphan mysqld is stopped tengine[20203]: 2007/09/19_16:08:04 info: unpack_graph: Unpacked transition 14: 8 actions in 8 synapses pengine[20204]: 2007/09/19_16:08:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[20204]: 2007/09/19_16:08:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 info: te_pseudo_action: Pseudo action 24 fired and confirmed pengine[20204]: 2007/09/19_16:08:04 info: group_print: Resource Group: group-DW tengine[20203]: 2007/09/19_16:08:04 notice: run_graph: ==================================================== pengine[20204]: 2007/09/19_16:08:04 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 WARN: run_graph: Transition 14: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[20204]: 2007/09/19_16:08:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 ERROR: te_graph_trigger: Transition failed: terminated pengine[20204]: 2007/09/19_16:08:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 15]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_print: msg_last (heartbeat:msg): Stopped crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource msg_first cannot run anywhere crmd[19464]: 2007/09/19_16:08:04 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource vmstat-mon cannot run anywhere crmd[19464]: 2007/09/19_16:08:04 info: do_shutdown_req: Processing shutdown locally tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource share-drbd cannot run anywhere crmd[19464]: 2007/09/19_16:08:04 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource share-FS cannot run anywhere tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 24]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource share-drbdlinks cannot run anywhere tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource msg_last cannot run anywhere tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:04 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 notice: StopRsc: host-1.awale.qc.ca Stop share-FS tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: native_color: Resource mysql cannot run anywhere tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 4 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: native_color: Stopping orphan resource mysqld tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:04 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 6 was confirmed (priority: 0) tengine[20203]: 2007/09/19_16:08:04 WARN: print_graph: Synapse 7 is pending (priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: [Action 16]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: log_cib_diff: cib_update: Diff: --- 0.9.15 tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: log_cib_diff: cib_update: Diff: +++ 0.9.16 tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:04 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - crmd[19464]: 2007/09/19_16:08:04 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:04 info: notify_crmd: Transition 14 status: te_complete - cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:08:04 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: - tengine[20203]: 2007/09/19_16:08:04 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:04 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:08:05 WARN: process_pe_message: Transition 14: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-146.bz2 pengine[20204]: 2007/09/19_16:08:05 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:05 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:05 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: process_orphan_resource: Making sure orphan mysqld is stopped crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:08:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 info: group_print: Resource Group: group-DW pengine[20204]: 2007/09/19_16:08:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 info: unpack_graph: Unpacked transition 15: 8 actions in 8 synapses pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[20203]: 2007/09/19_16:08:05 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[20204]: 2007/09/19_16:08:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[20203]: 2007/09/19_16:08:05 info: te_pseudo_action: Pseudo action 24 fired and confirmed pengine[20204]: 2007/09/19_16:08:05 info: native_print: msg_last (heartbeat:msg): Stopped tengine[20203]: 2007/09/19_16:08:05 notice: run_graph: ==================================================== pengine[20204]: 2007/09/19_16:08:05 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[20203]: 2007/09/19_16:08:05 WARN: run_graph: Transition 15: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource msg_first cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 ERROR: te_graph_trigger: Transition failed: terminated pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-drbd cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-FS cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 15]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-drbdlinks cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource msg_last cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop share-FS tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 24]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource mysql cannot run anywhere crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_color: Stopping orphan resource mysqld crmd[19464]: 2007/09/19_16:08:05 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown crmd[19464]: 2007/09/19_16:08:05 info: do_shutdown_req: Processing shutdown locally tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) crmd[19464]: 2007/09/19_16:08:05 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 4 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 6 was confirmed (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 16]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 info: notify_crmd: Transition 15 status: te_complete - cibmon[19458]: 2007/09/19_16:08:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:05 info: log_cib_diff: cib_update: Diff: --- 0.9.16 crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:05 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[19458]: 2007/09/19_16:08:05 info: log_cib_diff: cib_update: Diff: +++ 0.9.17 crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:05 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:08:05 WARN: process_pe_message: Transition 15: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-147.bz2 pengine[20204]: 2007/09/19_16:08:05 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:05 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:05 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:05 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:08:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 info: unpack_graph: Unpacked transition 16: 8 actions in 8 synapses pengine[20204]: 2007/09/19_16:08:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[20204]: 2007/09/19_16:08:05 info: group_print: Resource Group: group-DW tengine[20203]: 2007/09/19_16:08:05 info: te_pseudo_action: Pseudo action 24 fired and confirmed pengine[20204]: 2007/09/19_16:08:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 notice: run_graph: ==================================================== pengine[20204]: 2007/09/19_16:08:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: run_graph: Transition 16: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 ERROR: te_graph_trigger: Transition failed: terminated pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 15]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_print: msg_last (heartbeat:msg): Stopped crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[19464]: 2007/09/19_16:08:05 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource msg_first cannot run anywhere crmd[19464]: 2007/09/19_16:08:05 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource vmstat-mon cannot run anywhere crmd[19464]: 2007/09/19_16:08:05 info: do_shutdown_req: Processing shutdown locally tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-drbd cannot run anywhere crmd[19464]: 2007/09/19_16:08:05 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-FS cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource share-drbdlinks cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 24]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource msg_last cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 notice: StopRsc: host-1.awale.qc.ca Stop share-FS tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: native_color: Resource mysql cannot run anywhere tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: native_color: Stopping orphan resource mysqld tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 4 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:05 WARN: process_pe_message: Transition 16: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-148.bz2 tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 5 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:05 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 6 was confirmed (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: [Action 16]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 7]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 8]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:05 info: notify_crmd: Transition 16 status: te_complete - cibmon[19458]: 2007/09/19_16:08:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:05 info: log_cib_diff: cib_update: Diff: --- 0.9.17 cibmon[19458]: 2007/09/19_16:08:05 info: log_cib_diff: cib_update: Diff: +++ 0.9.18 cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:05 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:08:58 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=38, rc=7) complete cibmon[19458]: 2007/09/19_16:08:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: --- 0.9.18 cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: +++ 0.9.19 cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:58 info: process_graph_event: Detected action vmstat-mon_monitor_120000 from a different transition: 5 vs. 16 crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:58 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[20203]: 2007/09/19_16:08:58 WARN: update_failcount: Updating failcount for vmstat-mon on 1da8804b-8a93-4145-9d40-1133699fe377 after failed monitor: rc=7 pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:58 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:58 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Processing failed op (vmstat-mon_monitor_120000) on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: process_orphan_resource: Making sure orphan mysqld is stopped pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 info: group_print: Resource Group: group-DW tengine[20203]: 2007/09/19_16:08:58 info: unpack_graph: Unpacked transition 17: 8 actions in 8 synapses pengine[20204]: 2007/09/19_16:08:58 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[20204]: 2007/09/19_16:08:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca FAILED tengine[20203]: 2007/09/19_16:08:58 info: te_pseudo_action: Pseudo action 24 fired and confirmed pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 notice: run_graph: ==================================================== pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 WARN: run_graph: Transition 17: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[20203]: 2007/09/19_16:08:58 ERROR: te_graph_trigger: Transition failed: terminated pengine[20204]: 2007/09/19_16:08:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: msg_last (heartbeat:msg): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 15]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource msg_first cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-drbd cannot run anywhere crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-FS cannot run anywhere crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-drbdlinks cannot run anywhere crmd[19464]: 2007/09/19_16:08:58 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere crmd[19464]: 2007/09/19_16:08:58 info: do_shutdown_req: Processing shutdown locally tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource msg_last cannot run anywhere crmd[19464]: 2007/09/19_16:08:58 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 24]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop share-FS tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource mysql cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_color: Stopping orphan resource mysqld tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown cibmon[19458]: 2007/09/19_16:08:58 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_modify: Diff: --- 0.9.19 crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 4 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_modify: Diff: +++ 0.9.20 tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: process_pe_message: Transition 17: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-149.bz2 cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: - tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 5 is pending (priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 6 was confirmed (priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 7 is pending (priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 16]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_modify: + tengine[20203]: 2007/09/19_16:08:58 info: notify_crmd: Transition 17 status: te_complete - tengine[20203]: 2007/09/19_16:08:58 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[20203]: 2007/09/19_16:08:58 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[19458]: 2007/09/19_16:08:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: --- 0.9.20 cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: +++ 0.9.21 tengine[20203]: 2007/09/19_16:08:58 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[20204]: 2007/09/19_16:08:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[20204]: 2007/09/19_16:08:58 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[20204]: 2007/09/19_16:08:58 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Processing failed op (vmstat-mon_monitor_120000) on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: process_orphan_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 WARN: process_orphan_resource: Nothing known about resource mysqld running on host-1.awale.qc.ca pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource pengine[20204]: 2007/09/19_16:08:58 info: log_data_element: create_fake_resource: Orphan resource tengine[20203]: 2007/09/19_16:08:58 info: unpack_graph: Unpacked transition 18: 8 actions in 8 synapses pengine[20204]: 2007/09/19_16:08:58 info: process_orphan_resource: Making sure orphan mysqld is stopped tengine[20203]: 2007/09/19_16:08:58 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 info: te_pseudo_action: Pseudo action 24 fired and confirmed pengine[20204]: 2007/09/19_16:08:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 notice: run_graph: ==================================================== pengine[20204]: 2007/09/19_16:08:58 info: group_print: Resource Group: group-DW crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[20203]: 2007/09/19_16:08:58 WARN: run_graph: Transition 18: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=6) pengine[20204]: 2007/09/19_16:08:58 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:58 info: do_state_transition: (Re)Issuing shutdown request now that we are the DC tengine[20203]: 2007/09/19_16:08:58 ERROR: te_graph_trigger: Transition failed: terminated pengine[20204]: 2007/09/19_16:08:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca FAILED crmd[19464]: 2007/09/19_16:08:58 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 0 was confirmed (priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:58 info: do_shutdown_req: Processing shutdown locally tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca crmd[19464]: 2007/09/19_16:08:58 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 15]: Pending (id: group-DW_stopped_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: msg_last (heartbeat:msg): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource msg_first cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource vmstat-mon cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-drbd cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 24]: Completed (id: msg_last_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-FS cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource share-drbdlinks cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource msg_last cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop msg_first tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 notice: StopRsc: host-1.awale.qc.ca Stop share-FS tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 4 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: native_color: Resource mysql cannot run anywhere tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: native_color: Stopping orphan resource mysqld tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 5 is pending (priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: should_dump_action: action 11 (share-drbdlinks_stop_0) was for an unmanaged resource (share-drbdlinks) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 11]: Pending (id: share-drbdlinks_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 14]: Completed (id: group-DW_stop_0, type: pseduo, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 6 was confirmed (priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_graph: Synapse 7 is pending (priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: [Action 16]: Pending (id: do_shutdown, loc: host-1.awale.qc.ca, type: crm, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 3]: Pending (id: vmstat-mon_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 8]: Pending (id: msg_first_stop_0, loc: host-1.awale.qc.ca, priority: 0) tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 WARN: process_pe_message: Transition 18: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-150.bz2 tengine[20203]: 2007/09/19_16:08:58 WARN: print_elem: * [Input 10]: Pending (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) pengine[20204]: 2007/09/19_16:08:58 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[20203]: 2007/09/19_16:08:58 info: notify_crmd: Transition 18 status: te_complete - cibmon[19458]: 2007/09/19_16:08:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: --- 0.9.21 cibmon[19458]: 2007/09/19_16:08:58 info: log_cib_diff: cib_update: Diff: +++ 0.9.22 cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: - cibmon[19458]: 2007/09/19_16:08:58 info: log_data_element: cib_update: + cib[19460]: 2007/09/19_16:14:11 info: cib_stats: Processed 69 operations (20144.00us average, 0% utilization) in the last 10min heartbeat[19447]: 2007/09/19_16:14:43 info: Core process 19451 exited. 5 remaining heartbeat[19447]: 2007/09/19_16:14:43 info: Core process 19452 exited. 4 remaining heartbeat[19447]: 2007/09/19_16:14:43 info: Core process 19453 exited. 3 remaining heartbeat[19447]: 2007/09/19_16:14:43 info: Core process 19454 exited. 2 remaining heartbeat[19447]: 2007/09/19_16:14:43 info: Core process 19455 exited. 1 remaining heartbeat[19447]: 2007/09/19_16:14:43 info: host-1.awale.qc.ca Heartbeat shutdown complete. stonithd[19462]: 2007/09/19_16:14:43 ERROR: Disconnected with heartbeat daemon stonithd[19462]: 2007/09/19_16:14:43 notice: /usr/lib/heartbeat/stonithd normally quit. crmd[19464]: 2007/09/19_16:14:43 CRIT: crmd_ha_msg_dispatch: Lost connection to heartbeat service. tengine[20203]: 2007/09/19_16:14:43 ERROR: stonithd_op_result_ready: failed due to not on signon status. ccm[19459]: 2007/09/19_16:14:43 ERROR: Lost connection to heartbeat service. Need to bail out. tengine[20203]: 2007/09/19_16:14:43 ERROR: tengine_stonith_connection_destroy: Fencing daemon has left us cib[19460]: 2007/09/19_16:14:43 ERROR: cib_ha_connection_destroy: Heartbeat connection lost! Exiting. cib[19460]: 2007/09/19_16:14:43 ERROR: crm_abort: main: Triggered non-fatal assert at main.c:213 : g_hash_table_size(client_list) == 0 cib[19460]: 2007/09/19_16:14:43 WARN: main: Not all clients gone at exit attrd[19463]: 2007/09/19_16:14:43 CRIT: attrd_ha_dispatch: Lost connection to heartbeat service. crmd[19464]: 2007/09/19_16:14:43 info: mem_handle_func:IPC broken, ccm is dead before the client! attrd[19463]: 2007/09/19_16:14:43 CRIT: attrd_ha_connection_destroy: Lost connection to heartbeat service! crmd[19464]: 2007/09/19_16:14:43 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1. attrd[19463]: 2007/09/19_16:14:43 info: main: Exiting... crmd[19464]: 2007/09/19_16:14:43 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_IDLE) crmd[19464]: 2007/09/19_16:14:43 info: do_state_transition: State transition S_IDLE -> S_RECOVERY [ input=I_ERROR cause=C_CCM_CALLBACK origin=ccm_dispatch ] pengine[20204]: 2007/09/19_16:14:43 info: pengine_shutdown: Exiting PEngine (SIGTERM) crmd[19464]: 2007/09/19_16:14:43 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported crmd[19464]: 2007/09/19_16:14:43 WARN: do_election_vote: Not voting in election, we're in state S_RECOVERY crmd[19464]: 2007/09/19_16:14:43 info: do_dc_release: DC role released crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to pengine: [20204] crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 ERROR: do_log: [[FSA]] Input I_STOP from do_recover() received in state (S_RECOVERY) tengine[20203]: 2007/09/19_16:14:43 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[19464]: 2007/09/19_16:14:43 info: do_state_transition: State transition S_RECOVERY -> S_STOPPING [ input=I_STOP cause=C_FSA_INTERNAL origin=do_recover ] tengine[20203]: 2007/09/19_16:14:43 info: update_abort_priority: Abort action 2 superceeded by 3 crmd[19464]: 2007/09/19_16:14:43 info: do_dc_release: DC role released tengine[20203]: 2007/09/19_16:14:43 info: notify_crmd: Exiting after transition crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to pengine: [20204] tengine[20203]: 2007/09/19_16:14:43 info: te_init: Exiting tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the pengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to pengine: [20204] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Waiting for subsystems to exit crmd[19464]: 2007/09/19_16:14:43 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[19464]: 2007/09/19_16:14:43 WARN: do_log: [[FSA]] Input I_PENDING from do_election_vote() received in state (S_STOPPING) crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the pengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to pengine: [20204] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Waiting for subsystems to exit crmd[19464]: 2007/09/19_16:14:43 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[19464]: 2007/09/19_16:14:43 info: crmdManagedChildDied: Process pengine:[20204] exited (signal=0, exitcode=0) crmd[19464]: 2007/09/19_16:14:43 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Waiting for subsystems to exit crmd[19464]: 2007/09/19_16:14:43 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs crmd[19464]: 2007/09/19_16:14:43 info: process_client_disconnect: Received HUP from pengine:[-1] crmd[19464]: 2007/09/19_16:14:43 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Waiting for subsystems to exit crmd[19464]: 2007/09/19_16:14:43 info: process_client_disconnect: Received HUP from tengine:[20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Terminating the tengine crmd[19464]: 2007/09/19_16:14:43 info: stop_subsystem: Sent -TERM to tengine: [20203] crmd[19464]: 2007/09/19_16:14:43 info: do_shutdown: Waiting for subsystems to exit crmd[19464]: 2007/09/19_16:14:43 WARN: Exiting tengine process 20203 killed by signal 11 [SIGSEGV - Segmentation violation]. crmd[19464]: 2007/09/19_16:14:43 ERROR: Exiting tengine process 20203 dumped core crmd[19464]: 2007/09/19_16:14:43 info: crmdManagedChildDied: Process tengine:[20203] exited (signal=11, exitcode=0) crmd[19464]: 2007/09/19_16:14:43 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[19464]: 2007/09/19_16:14:43 info: verify_stopped: Checking for active resources before exit crmd[19464]: 2007/09/19_16:14:43 info: verify_stopped: Checking for active resources before exit cibmon[19458]: 2007/09/19_16:14:43 info: cib_native_msgready: Lost connection to the CIB service [19460]. cibmon[19458]: 2007/09/19_16:14:43 CRIT: cib_native_dispatch: Lost connection to the CIB service [19460/callback]. cibmon[19458]: 2007/09/19_16:14:43 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting crmd[19464]: 2007/09/19_16:14:43 info: cib_native_msgready: Lost connection to the CIB service [19460]. crmd[19464]: 2007/09/19_16:14:43 CRIT: cib_native_dispatch: Lost connection to the CIB service [19460/callback]. crmd[19464]: 2007/09/19_16:14:43 ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[19464]: 2007/09/19_16:14:43 ERROR: do_log: [[FSA]] Input I_ERROR from crmd_cib_connection_destroy() received in state (S_TERMINATE) crmd[19464]: 2007/09/19_16:14:43 info: verify_stopped: Checking for active resources before exit crmd[19464]: 2007/09/19_16:14:43 ERROR: verify_stopped: 4 pending LRM operations at shutdown crmd[19464]: 2007/09/19_16:14:43 ERROR: ghash_print_pending: Pending action: msg_first:36 crmd[19464]: 2007/09/19_16:14:43 ERROR: ghash_print_pending: Pending action: vmstat-mon:38 crmd[19464]: 2007/09/19_16:14:43 ERROR: ghash_print_pending: Pending action: share-drbd:40 crmd[19464]: 2007/09/19_16:14:43 ERROR: ghash_print_pending: Pending action: share-FS:42 crmd[19464]: 2007/09/19_16:14:43 ERROR: verify_stopped: Resource msg_first was active at shutdown. You may ignore this error if it is unmanaged. crmd[19464]: 2007/09/19_16:14:43 ERROR: verify_stopped: Resource share-drbd was active at shutdown. You may ignore this error if it is unmanaged. crmd[19464]: 2007/09/19_16:14:43 ERROR: verify_stopped: Resource share-FS was active at shutdown. You may ignore this error if it is unmanaged. crmd[19464]: 2007/09/19_16:14:43 ERROR: verify_stopped: Resource share-drbdlinks was active at shutdown. You may ignore this error if it is unmanaged. crmd[19464]: 2007/09/19_16:14:43 ERROR: do_exit: Performing A_EXIT_1 - forcefully exiting the CRMd crmd[19464]: 2007/09/19_16:14:43 ERROR: do_exit: Could not recover from internal error crmd[19464]: 2007/09/19_16:14:43 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[19464]: 2007/09/19_16:14:43 info: do_exit: [crmd] stopped (2) logd[14791]: 2007/09/19_16:14:44 info: logd_term_write_action: received SIGTERM logd[14791]: 2007/09/19_16:14:44 info: Exiting write process logd[3216]: 2007/09/19_16:18:04 info: logd started with /etc/logd.cf. logd[3221]: 2007/09/19_16:18:04 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[3216]: 2007/09/19_16:18:04 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[3237]: 2007/09/19_16:18:04 info: No log entry found in ha.cf -- use logd heartbeat[3237]: 2007/09/19_16:18:04 info: Enabling logging daemon heartbeat[3237]: 2007/09/19_16:18:04 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[3237]: 2007/09/19_16:18:04 info: ************************** heartbeat[3237]: 2007/09/19_16:18:04 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[3238]: 2007/09/19_16:18:04 info: heartbeat: version 2.1.2 heartbeat[3238]: 2007/09/19_16:18:04 info: Heartbeat generation: 1188360847 heartbeat[3238]: 2007/09/19_16:18:04 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[3238]: 2007/09/19_16:18:04 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[3238]: 2007/09/19_16:18:04 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[3238]: 2007/09/19_16:18:04 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[3238]: 2007/09/19_16:18:04 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[3238]: 2007/09/19_16:18:04 info: glib: ping group heartbeat started. heartbeat[3238]: 2007/09/19_16:18:04 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[3238]: 2007/09/19_16:18:04 info: Local status now set to: 'up' heartbeat[3238]: 2007/09/19_16:18:05 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[3238]: 2007/09/19_16:18:06 info: Link local:local up. heartbeat[3238]: 2007/09/19_16:18:06 info: Status update for node local: status ping heartbeat[3238]: 2007/09/19_16:18:25 WARN: node host-2.awale.qc.ca: is dead heartbeat[3238]: 2007/09/19_16:18:25 info: Comm_now_up(): updating status to active heartbeat[3238]: 2007/09/19_16:18:25 info: Local status now set to: 'active' heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[3998]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 3998) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[3238]: 2007/09/19_16:18:25 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[3997]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 3997) heartbeat[3999]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 3999) heartbeat[4000]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 4000) cibmon[3997]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[4001]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 4001) heartbeat[4004]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 4004) heartbeat[4002]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 4002) cib[3999]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[3999]: 2007/09/19_16:18:25 info: G_main_add_TriggerHandler: Added signal manual handler cib[3999]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[3999]: 2007/09/19_16:18:25 info: main: Retrieval of a per-action CIB: disabled cib[3999]: 2007/09/19_16:18:25 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] ccm[3998]: 2007/09/19_16:18:25 info: Hostname: host-1.awale.qc.ca cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] lrmd[4000]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: log_data_element: readCibXmlFile: [on-disk] cib[3999]: 2007/09/19_16:18:25 info: startCib: CIB Initialization completed successfully cib[3999]: 2007/09/19_16:18:25 info: cib_register_ha: Signing in with Heartbeat cib[3999]: 2007/09/19_16:18:25 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[3999]: 2007/09/19_16:18:25 WARN: cib_init: CCM Activation failed cib[3999]: 2007/09/19_16:18:25 WARN: cib_init: CCM Connection failed 1 times (30 max) attrd[4002]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[4000]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[4000]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[4000]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[4000]: 2007/09/19_16:18:25 info: Started. attrd[4002]: 2007/09/19_16:18:25 info: register_with_ha: Hostname: host-1.awale.qc.ca heartbeat[4003]: 2007/09/19_16:18:25 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 4003) stonithd[4001]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[4001]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[4002]: 2007/09/19_16:18:25 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[4003]: 2007/09/19_16:18:25 info: main: CRM Hg Version: 9a995a8a7052 tip stonithd[4001]: 2007/09/19_16:18:25 info: Signing in with heartbeat. crmd[4003]: 2007/09/19_16:18:25 info: crmd_init: Starting crmd crmd[4003]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[4003]: 2007/09/19_16:18:25 info: G_main_add_TriggerHandler: Added signal manual handler crmd[4003]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[4004]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[4004]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[4004]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[4001]: 2007/09/19_16:18:25 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[4001]: 2007/09/19_16:18:25 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[4004]: 2007/09/19_16:18:25 info: init_crm ccm[3998]: 2007/09/19_16:18:26 info: Break tie for 2 nodes cluster ccm[3998]: 2007/09/19_16:18:26 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[3999]: 2007/09/19_16:18:26 info: cib_init: Starting cib mainloop cib[3999]: 2007/09/19_16:18:26 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[3999]: 2007/09/19_16:18:26 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[3999]: 2007/09/19_16:18:26 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:26 info: main: Starting mainloop cib[3999]: 2007/09/19_16:18:26 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[4003]: 2007/09/19_16:18:26 info: do_cib_control: CIB connection established crmd[4003]: 2007/09/19_16:18:26 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[3999]: 2007/09/19_16:18:26 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[3999]: 2007/09/19_16:18:26 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[3999]: 2007/09/19_16:18:26 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[3999]: 2007/09/19_16:18:26 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[4005]: 2007/09/19_16:18:26 info: write_cib_contents: Wrote version 0.9.1 of the CIB to disk (digest: 0aa19fcd6e25d69b0dd3a60754ce6967) crmd[4003]: 2007/09/19_16:18:27 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[4003]: 2007/09/19_16:18:27 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[4004]: 2007/09/19_16:18:27 info: Started. crmd[4003]: 2007/09/19_16:18:28 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[4003]: 2007/09/19_16:18:28 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[4003]: 2007/09/19_16:18:29 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[4003]: 2007/09/19_16:18:29 info: do_ha_control: Connected to Heartbeat crmd[4003]: 2007/09/19_16:18:29 info: do_ccm_control: CCM connection established... waiting for first callback crmd[4003]: 2007/09/19_16:18:29 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[4003]: 2007/09/19_16:18:29 info: crmd_init: Starting crmd's mainloop crmd[4003]: 2007/09/19_16:18:29 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[4003]: 2007/09/19_16:18:29 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[3997]: 2007/09/19_16:18:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:29 info: log_cib_diff: cib_update: Local-only Change: 0.9.1 cibmon[3997]: 2007/09/19_16:18:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:29 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:30 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[4003]: 2007/09/19_16:18:30 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[4003]: 2007/09/19_16:18:30 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[4003]: 2007/09/19_16:18:30 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[4003]: 2007/09/19_16:18:30 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[4003]: 2007/09/19_16:18:30 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[4003]: 2007/09/19_16:18:30 info: do_started: Delaying start, Config not read (0000000000000040) crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[4003]: 2007/09/19_16:18:30 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[4003]: 2007/09/19_16:18:30 info: do_started: The local CRM is operational cibmon[3997]: 2007/09/19_16:18:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[4003]: 2007/09/19_16:18:30 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ] cibmon[3997]: 2007/09/19_16:18:30 info: log_cib_diff: cib_update: Local-only Change: 0.9.1 crmd[4003]: 2007/09/19_16:18:30 info: update_dc: Set DC to () cibmon[3997]: 2007/09/19_16:18:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:30 info: log_data_element: cib_update: + attrd[4002]: 2007/09/19_16:18:31 info: main: Starting mainloop... crmd[4003]: 2007/09/19_16:18:41 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[4003]: 2007/09/19_16:18:41 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[4003]: 2007/09/19_16:18:41 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[4003]: 2007/09/19_16:18:41 info: update_dc: Set DC to () crmd[4003]: 2007/09/19_16:18:41 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[4003]: 2007/09/19_16:18:41 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_16:18:41 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[4003]: 2007/09/19_16:18:41 info: start_subsystem: Starting sub-system "tengine" crmd[4003]: 2007/09/19_16:18:41 info: start_subsystem: Starting sub-system "pengine" crmd[4003]: 2007/09/19_16:18:41 info: do_dc_takeover: Taking over DC status for this partition cib[3999]: 2007/09/19_16:18:41 info: cib_process_readwrite: We are now in R/W mode cibmon[3997]: 2007/09/19_16:18:41 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:41 info: log_cib_diff: cib_update: Diff: --- 0.9.1 cibmon[3997]: 2007/09/19_16:18:41 info: log_cib_diff: cib_update: Diff: +++ 0.9.2 cibmon[3997]: 2007/09/19_16:18:41 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:41 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[4069]: 2007/09/19_16:18:41 info: G_main_add_TriggerHandler: Added signal manual handler crmd[4003]: 2007/09/19_16:18:41 info: update_dc: Set DC to () crmd[4003]: 2007/09/19_16:18:41 info: join_make_offer: Making join offers based on membership 1 crmd[4003]: 2007/09/19_16:18:41 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cib[3999]: 2007/09/19_16:18:41 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[4069]: 2007/09/19_16:18:41 info: te_init: Registering TE UUID: a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_16:18:41 info: set_graph_functions: Setting custom graph functions tengine[4069]: 2007/09/19_16:18:41 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[4069]: 2007/09/19_16:18:41 info: te_init: Starting tengine pengine[4070]: 2007/09/19_16:18:41 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[4070]: 2007/09/19_16:18:41 info: pe_init: Starting pengine crmd[4003]: 2007/09/19_16:18:41 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_16:18:42 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[4003]: 2007/09/19_16:18:42 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[4003]: 2007/09/19_16:18:42 info: update_attrd: Connecting to attrd... attrd[4002]: 2007/09/19_16:18:42 info: attrd_local_callback: Sending full refresh cib[3999]: 2007/09/19_16:18:42 info: sync_our_cib: Syncing CIB to all peers cibmon[3997]: 2007/09/19_16:18:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: --- 0.9.2 cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: +++ 0.9.3 cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: --- 0.9.3 cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: +++ 0.9.4 cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:42 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_16:18:42 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:42 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: --- 0.9.4 crmd[4003]: 2007/09/19_16:18:42 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[3997]: 2007/09/19_16:18:42 info: log_cib_diff: cib_update: Diff: +++ 0.9.5 crmd[4003]: 2007/09/19_16:18:42 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:42 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:42 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_16:18:42 info: update_abort_priority: 'DC Takeover' abort superceeded pengine[4070]: 2007/09/19_16:18:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:18:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:18:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:18:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:18:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:18:42 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:18:42 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:18:42 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:18:42 info: native_print: msg_first (heartbeat:msg): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: msg_last (heartbeat:msg): Stopped pengine[4070]: 2007/09/19_16:18:42 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_16:18:42 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_16:18:42 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-49.bz2 crmd[4003]: 2007/09/19_16:18:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:18:43 info: unpack_graph: Unpacked transition 0: 28 actions in 28 synapses tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 3: msg_first_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 4: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 5: share-drbd_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 6: share-FS_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 7: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 8: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 9: msg_last_monitor_0 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=3:0:a38b4c13-e34c-4084-9370-1d4f139bb940) tengine[4069]: 2007/09/19_16:18:43 info: send_rsc_command: Initiating action 10: mysql_monitor_0 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=4:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=5:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=6:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=7:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=8:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=9:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=10:0:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete cibmon[3997]: 2007/09/19_16:18:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:43 info: match_graph_event: Action vmstat-mon_monitor_0 (4) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: --- 0.9.5 cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: +++ 0.9.6 cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:43 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=7) complete cibmon[3997]: 2007/09/19_16:18:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: --- 0.9.6 cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: +++ 0.9.7 cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:18:43 info: match_graph_event: Action share-drbd_monitor_0 (5) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[4003]: 2007/09/19_16:18:43 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete tengine[4069]: 2007/09/19_16:18:43 info: match_graph_event: Action msg_first_monitor_0 (3) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: --- 0.9.7 cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: +++ 0.9.8 cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:43 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[3997]: 2007/09/19_16:18:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (8) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: --- 0.9.8 cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: +++ 0.9.9 cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:43 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=7) complete cibmon[3997]: 2007/09/19_16:18:43 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: --- 0.9.9 tengine[4069]: 2007/09/19_16:18:43 info: match_graph_event: Action share-FS_monitor_0 (6) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:43 info: log_cib_diff: cib_update: Diff: +++ 0.9.10 cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:43 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:44 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=7) complete cibmon[3997]: 2007/09/19_16:18:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: --- 0.9.10 cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: +++ 0.9.11 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:44 info: match_graph_event: Action share-drbdlinks_monitor_0 (7) confirmed on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:44 info: process_lrm_event: LRM operation mysql_monitor_0 (call=9, rc=7) complete cibmon[3997]: 2007/09/19_16:18:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: --- 0.9.11 cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: +++ 0.9.12 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:44 info: match_graph_event: Action mysql_monitor_0 (10) confirmed on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:44 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=8, rc=7) complete cibmon[3997]: 2007/09/19_16:18:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:44 info: match_graph_event: Action msg_last_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: --- 0.9.12 tengine[4069]: 2007/09/19_16:18:44 info: send_rsc_command: Initiating action 2: probe_complete on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_update: Diff: +++ 0.9.13 tengine[4069]: 2007/09/19_16:18:44 info: te_pseudo_action: Pseudo action 1 fired and confirmed cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:18:44 info: te_pseudo_action: Pseudo action 25 fired and confirmed cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:44 info: send_rsc_command: Initiating action 11: msg_first_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:44 info: send_rsc_command: Initiating action 29: mysql_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:44 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=11:0:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:44 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_modify: Diff: --- 0.9.13 cibmon[3997]: 2007/09/19_16:18:44 info: log_cib_diff: cib_modify: Diff: +++ 0.9.14 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: - tengine[4069]: 2007/09/19_16:18:44 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_16:18:44 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_16:18:44 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:18:44 info: log_data_element: cib_modify: + crmd[4003]: 2007/09/19_16:18:44 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=29:0:a38b4c13-e34c-4084-9370-1d4f139bb940) msg[4172][4213]: 2007/09/19_16:18:44 INFO Starting to switch to this node. msg[4172][4218]: 2007/09/19_16:18:44 INFO Node: host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:45 info: process_lrm_event: LRM operation msg_first_start_0 (call=10, rc=0) complete crmd[4003]: 2007/09/19_16:18:45 info: build_operation_update: Digest for 0:0;11:0:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[4003]: 2007/09/19_16:18:45 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:45 info: match_graph_event: Action msg_first_start_0 (11) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:45 info: log_cib_diff: cib_update: Diff: --- 0.9.14 cibmon[3997]: 2007/09/19_16:18:45 info: log_cib_diff: cib_update: Diff: +++ 0.9.15 cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:45 info: log_data_element: cib_update: + mysql[4173][4270]: 2007/09/19_16:18:48 INFO: MySQL started crmd[4003]: 2007/09/19_16:18:48 info: process_lrm_event: LRM operation mysql_start_0 (call=11, rc=0) complete crmd[4003]: 2007/09/19_16:18:48 info: build_operation_update: Digest for 0:0;29:0:a38b4c13-e34c-4084-9370-1d4f139bb940 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[4003]: 2007/09/19_16:18:48 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:48 info: log_cib_diff: cib_update: Diff: --- 0.9.15 cibmon[3997]: 2007/09/19_16:18:48 info: log_cib_diff: cib_update: Diff: +++ 0.9.16 cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:18:48 info: match_graph_event: Action mysql_start_0 (29) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:48 info: run_graph: ==================================================== cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:18:48 notice: run_graph: Transition 0: (Complete=13, Pending=0, Fired=0, Skipped=15, Incomplete=0) cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:48 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:48 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:18:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:18:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:18:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:18:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:18:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:18:48 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:18:48 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:18:48 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:18:48 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:18:48 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: msg_last (heartbeat:msg): Stopped pengine[4070]: 2007/09/19_16:18:48 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:18:48 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 crmd[4003]: 2007/09/19_16:18:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[4070]: 2007/09/19_16:18:48 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[4070]: 2007/09/19_16:18:48 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:18:48 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_16:18:49 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-50.bz2 tengine[4069]: 2007/09/19_16:18:49 info: unpack_graph: Unpacked transition 1: 17 actions in 17 synapses tengine[4069]: 2007/09/19_16:18:49 info: te_pseudo_action: Pseudo action 18 fired and confirmed tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 4: msg_first_start_0 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=4:1:a38b4c13-e34c-4084-9370-1d4f139bb940) tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 24: mysql_monitor_120000 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=24:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:49 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=13, rc=0) complete cibmon[3997]: 2007/09/19_16:18:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:49 info: match_graph_event: Action mysql_monitor_120000 (24) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: --- 0.9.16 cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.17 cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + msg[4279][4308]: 2007/09/19_16:18:49 INFO Starting to switch to this node. msg[4279][4309]: 2007/09/19_16:18:49 INFO Node: host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:49 info: process_lrm_event: LRM operation msg_first_start_0 (call=12, rc=0) complete crmd[4003]: 2007/09/19_16:18:49 info: build_operation_update: Digest for 0:0;4:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[4003]: 2007/09/19_16:18:49 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: --- 0.9.17 tengine[4069]: 2007/09/19_16:18:49 info: match_graph_event: Action msg_first_start_0 (4) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.18 tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 5: msg_first_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 6: vmstat-mon_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=5:1:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=6:1:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + daemontools[4320][4343]: 2007/09/19_16:18:49 INFO Starting vmstat-mon crmd[4003]: 2007/09/19_16:18:49 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=14, rc=0) complete cibmon[3997]: 2007/09/19_16:18:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:49 info: match_graph_event: Action msg_first_monitor_120000 (5) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: --- 0.9.18 cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.19 cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:49 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=15, rc=0) complete cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:49 info: build_operation_update: Digest for 0:0;6:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[4003]: 2007/09/19_16:18:49 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: --- 0.9.19 cibmon[3997]: 2007/09/19_16:18:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.20 cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:49 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:49 info: match_graph_event: Action vmstat-mon_start_0 (6) confirmed on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 7: vmstat-mon_monitor_120000 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:49 info: send_rsc_command: Initiating action 8: share-drbd_start_0 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=7:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:49 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=8:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:50 info: process_lrm_event: LRM operation share-drbd_start_0 (call=17, rc=0) complete crmd[4003]: 2007/09/19_16:18:50 info: build_operation_update: Digest for 0:0;8:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[4003]: 2007/09/19_16:18:50 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: --- 0.9.20 cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: +++ 0.9.21 cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:50 info: match_graph_event: Action share-drbd_start_0 (8) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:50 info: send_rsc_command: Initiating action 9: share-drbd_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:50 info: send_rsc_command: Initiating action 10: share-FS_start_0 on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:50 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=9:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:50 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=10:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:50 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=16, rc=0) complete cibmon[3997]: 2007/09/19_16:18:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:50 info: match_graph_event: Action vmstat-mon_monitor_120000 (7) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: --- 0.9.21 cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: +++ 0.9.22 cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:50 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=18, rc=0) complete cibmon[3997]: 2007/09/19_16:18:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:50 info: match_graph_event: Action share-drbd_monitor_120000 (9) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: --- 0.9.22 cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: +++ 0.9.23 cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + Filesystem[4366][4398]: 2007/09/19_16:18:50 INFO: Running start for /dev/drbd0 on /share crmd[4003]: 2007/09/19_16:18:50 info: process_lrm_event: LRM operation share-FS_start_0 (call=19, rc=0) complete crmd[4003]: 2007/09/19_16:18:50 info: build_operation_update: Digest for 0:0;10:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[4003]: 2007/09/19_16:18:50 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:50 info: match_graph_event: Action share-FS_start_0 (10) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: --- 0.9.23 tengine[4069]: 2007/09/19_16:18:50 info: send_rsc_command: Initiating action 11: share-FS_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_cib_diff: cib_update: Diff: +++ 0.9.24 tengine[4069]: 2007/09/19_16:18:50 info: send_rsc_command: Initiating action 12: share-drbdlinks_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:50 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=11:1:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:50 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=12:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:51 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=21, rc=0) complete crmd[4003]: 2007/09/19_16:18:51 info: build_operation_update: Digest for 0:0;12:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[4003]: 2007/09/19_16:18:51 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:51 info: match_graph_event: Action share-drbdlinks_start_0 (12) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: --- 0.9.24 tengine[4069]: 2007/09/19_16:18:51 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: +++ 0.9.25 tengine[4069]: 2007/09/19_16:18:51 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:51 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=13:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=14:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:51 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=22, rc=0) complete cibmon[3997]: 2007/09/19_16:18:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: --- 0.9.25 cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: +++ 0.9.26 cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:51 info: match_graph_event: Action share-drbdlinks_monitor_120000 (13) confirmed on host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:51 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=20, rc=0) complete cibmon[3997]: 2007/09/19_16:18:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:51 info: match_graph_event: Action share-FS_monitor_120000 (11) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: --- 0.9.26 cibmon[3997]: 2007/09/19_16:18:51 info: log_cib_diff: cib_update: Diff: +++ 0.9.27 cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:51 info: log_data_element: cib_update: + IPaddr[4444][4488]: 2007/09/19_16:18:51 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[4444][4493]: 2007/09/19_16:18:51 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[4444][4515]: 2007/09/19_16:18:51 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[4003]: 2007/09/19_16:18:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=23, rc=0) complete crmd[4003]: 2007/09/19_16:18:52 info: build_operation_update: Digest for 0:0;14:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[4003]: 2007/09/19_16:18:52 info: log_data_element: build_operation_update: digest:source tengine[4069]: 2007/09/19_16:18:52 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (14) confirmed on host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:18:52 info: send_rsc_command: Initiating action 15: IPaddr_10_0_0_59_monitor_5000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:18:52 info: send_rsc_command: Initiating action 16: msg_last_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: --- 0.9.27 cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: +++ 0.9.28 cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:52 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=15:1:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:52 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=16:1:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:18:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=24, rc=0) complete cibmon[3997]: 2007/09/19_16:18:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: --- 0.9.28 cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: +++ 0.9.29 cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:52 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (15) confirmed on host-1.awale.qc.ca msg[4546][4580]: 2007/09/19_16:18:52 INFO Completed switching to this node. msg[4546][4581]: 2007/09/19_16:18:52 INFO Node: host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:18:52 info: process_lrm_event: LRM operation msg_last_start_0 (call=25, rc=0) complete crmd[4003]: 2007/09/19_16:18:52 info: build_operation_update: Digest for 0:0;16:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[4003]: 2007/09/19_16:18:52 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:18:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: --- 0.9.29 cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: +++ 0.9.30 tengine[4069]: 2007/09/19_16:18:52 info: match_graph_event: Action msg_last_start_0 (16) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:18:52 info: te_pseudo_action: Pseudo action 19 fired and confirmed cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:18:52 info: send_rsc_command: Initiating action 17: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=17:1:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:18:52 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=26, rc=0) complete cibmon[3997]: 2007/09/19_16:18:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[4003]: 2007/09/19_16:18:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:18:52 info: match_graph_event: Action msg_last_monitor_120000 (17) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: --- 0.9.30 tengine[4069]: 2007/09/19_16:18:52 info: run_graph: Transition 1: (Complete=17, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_16:18:52 info: log_cib_diff: cib_update: Diff: +++ 0.9.31 tengine[4069]: 2007/09/19_16:18:52 info: notify_crmd: Transition 1 status: te_complete - cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:18:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:22:49 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=13, rc=7) complete cibmon[3997]: 2007/09/19_16:22:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:22:49 info: process_graph_event: Action mysql_monitor_120000 arrived after a completed transition cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_update: Diff: --- 0.9.31 crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:22:49 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.32 crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:22:49 WARN: update_failcount: Updating failcount for mysql on 1da8804b-8a93-4145-9d40-1133699fe377 after failed monitor: rc=7 cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:22:49 WARN: unpack_rsc_op: Processing failed op (mysql_monitor_120000) on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:22:49 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca FAILED pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Recover resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[4070]: 2007/09/19_16:22:49 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_16:22:49 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:22:49 info: unpack_graph: Unpacked transition 2: 3 actions in 3 synapses tengine[4069]: 2007/09/19_16:22:49 info: send_rsc_command: Initiating action 8: mysql_stop_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-51.bz2 crmd[4003]: 2007/09/19_16:22:49 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=8:2:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:22:49 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[4069]: 2007/09/19_16:22:49 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_modify: Diff: --- 0.9.32 tengine[4069]: 2007/09/19_16:22:49 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_modify: Diff: +++ 0.9.33 tengine[4069]: 2007/09/19_16:22:49 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + crmd[4003]: 2007/09/19_16:22:49 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=13, rc=-2) Cancelled cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_16:22:49 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_delete: Diff: --- 0.9.33 cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_delete: Diff: +++ 0.9.34 cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_delete: + crmd[4003]: 2007/09/19_16:22:49 info: process_lrm_event: LRM operation mysql_stop_0 (call=27, rc=0) complete cibmon[3997]: 2007/09/19_16:22:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_update: Diff: --- 0.9.34 cibmon[3997]: 2007/09/19_16:22:49 info: log_cib_diff: cib_update: Diff: +++ 0.9.35 tengine[4069]: 2007/09/19_16:22:49 info: match_graph_event: Action mysql_stop_0 (8) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:22:49 info: run_graph: ==================================================== cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:22:49 notice: run_graph: Transition 2: (Complete=1, Pending=0, Fired=0, Skipped=2, Incomplete=0) cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:49 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:22:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:22:49 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:22:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:22:49 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:22:49 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_16:22:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:22:49 info: unpack_graph: Unpacked transition 3: 2 actions in 2 synapses pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:22:49 info: send_rsc_command: Initiating action 28: mysql_start_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:22:49 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_16:22:49 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 crmd[4003]: 2007/09/19_16:22:49 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=28:3:a38b4c13-e34c-4084-9370-1d4f139bb940) pengine[4070]: 2007/09/19_16:22:49 info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-52.bz2 mysql[5799][5958]: 2007/09/19_16:22:54 INFO: MySQL started crmd[4003]: 2007/09/19_16:22:54 info: process_lrm_event: LRM operation mysql_start_0 (call=28, rc=0) complete crmd[4003]: 2007/09/19_16:22:54 info: build_operation_update: Digest for 0:0;28:3:a38b4c13-e34c-4084-9370-1d4f139bb940 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[4003]: 2007/09/19_16:22:54 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:22:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:22:54 info: match_graph_event: Action mysql_start_0 (28) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:22:54 info: log_cib_diff: cib_update: Diff: --- 0.9.35 tengine[4069]: 2007/09/19_16:22:54 info: send_rsc_command: Initiating action 29: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:22:54 info: log_cib_diff: cib_update: Diff: +++ 0.9.36 cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_16:22:54 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=29:3:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:22:54 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=29, rc=0) complete cibmon[3997]: 2007/09/19_16:22:54 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:22:54 info: log_cib_diff: cib_update: Diff: --- 0.9.36 cibmon[3997]: 2007/09/19_16:22:54 info: log_cib_diff: cib_update: Diff: +++ 0.9.37 tengine[4069]: 2007/09/19_16:22:54 info: match_graph_event: Action mysql_monitor_120000 (29) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:22:54 info: run_graph: Transition 3: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:22:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:22:54 info: notify_crmd: Transition 3 status: te_complete - cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:22:54 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_create: Diff: --- 0.9.37 cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_create: Diff: +++ 0.10.1 cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: - cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + tengine[4069]: 2007/09/19_16:27:02 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + crmd[4003]: 2007/09/19_16:27:02 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: - crmd[4003]: 2007/09/19_16:27:02 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:27:02 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:27:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:27:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:27:02 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:27:02 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:27:02 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:27:02 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:27:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:27:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:27:02 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Stopped tengine[4069]: 2007/09/19_16:27:02 info: unpack_graph: Unpacked transition 4: 8 actions in 8 synapses pengine[4070]: 2007/09/19_16:27:02 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped tengine[4069]: 2007/09/19_16:27:02 info: send_rsc_command: Initiating action 11: child_DoFencing:0_monitor_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:27:02 info: send_rsc_command: Initiating action 12: child_DoFencing:1_monitor_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:27:02 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:27:02 notice: StartRsc: host-1.awale.qc.ca Start child_DoFencing:0 pengine[4070]: 2007/09/19_16:27:02 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_5000 pengine[4070]: 2007/09/19_16:27:02 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-151.bz2 pengine[4070]: 2007/09/19_16:27:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[4003]: 2007/09/19_16:27:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_0 key=11:4:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:27:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:1_monitor_0 key=12:4:a38b4c13-e34c-4084-9370-1d4f139bb940) crmd[4003]: 2007/09/19_16:27:02 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_0 (call=30, rc=7) complete crmd[4003]: 2007/09/19_16:27:02 info: process_lrm_event: LRM operation child_DoFencing:1_monitor_0 (call=31, rc=7) complete cibmon[3997]: 2007/09/19_16:27:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_update: Diff: --- 0.10.1 cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_update: Diff: +++ 0.10.2 cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: - cib[6835]: 2007/09/19_16:27:02 info: write_cib_contents: Wrote version 0.10.1 of the CIB to disk (digest: 6ddefb47b4dc50706e90ed202b198160) cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: match_graph_event: Action child_DoFencing:0_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_update: Diff: --- 0.10.2 cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_update: Diff: +++ 0.10.3 cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: match_graph_event: Action child_DoFencing:1_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: send_rsc_command: Initiating action 10: probe_complete on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: te_pseudo_action: Pseudo action 9 fired and confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: te_pseudo_action: Pseudo action 35 fired and confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:02 info: send_rsc_command: Initiating action 33: child_DoFencing:0_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:27:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=33:4:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:27:02 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_modify: Diff: --- 0.10.3 cibmon[3997]: 2007/09/19_16:27:02 info: log_cib_diff: cib_modify: Diff: +++ 0.10.4 cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:27:02 info: log_data_element: cib_modify: + lrmd[6840]: 2007/09/19_16:27:02 info: Try to start STONITH resource : Device=apcsnmp stonithd[6841]: 2007/09/19_16:27:03 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6841]: 2007/09/19_16:27:03 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_16:27:03 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=32, rc=0) complete crmd[4003]: 2007/09/19_16:27:03 info: build_operation_update: Digest for 0:0;33:4:a38b4c13-e34c-4084-9370-1d4f139bb940 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[4003]: 2007/09/19_16:27:03 info: log_data_element: build_operation_update: digest:source lrmd[4000]: 2007/09/19_16:27:03 WARN: stonithRA plugin: cannot get shortdesc segment of apcsnmp's metadata. stonithd[4001]: 2007/09/19_16:27:03 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cibmon[3997]: 2007/09/19_16:27:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:27:03 info: log_cib_diff: cib_update: Diff: --- 0.10.4 cibmon[3997]: 2007/09/19_16:27:03 info: log_cib_diff: cib_update: Diff: +++ 0.10.5 cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:27:03 info: match_graph_event: Action child_DoFencing:0_start_0 (33) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:03 info: send_rsc_command: Initiating action 34: child_DoFencing:0_monitor_5000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_16:27:03 info: te_pseudo_action: Pseudo action 36 fired and confirmed cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:27:03 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_5000 key=34:4:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + stonithd[4001]: 2007/09/19_16:27:03 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:27:03 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 340 ms (> 30 ms) (GSource: 0x98fccf0) stonithd[6843]: 2007/09/19_16:27:03 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6843]: 2007/09/19_16:27:03 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_16:27:03 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_5000 (call=33, rc=0) complete cibmon[3997]: 2007/09/19_16:27:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_16:27:03 info: log_cib_diff: cib_update: Diff: --- 0.10.5 cibmon[3997]: 2007/09/19_16:27:03 info: log_cib_diff: cib_update: Diff: +++ 0.10.6 tengine[4069]: 2007/09/19_16:27:03 info: match_graph_event: Action child_DoFencing:0_monitor_5000 (34) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:27:03 info: run_graph: Transition 4: (Complete=8, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:27:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:27:03 info: notify_crmd: Transition 4 status: te_complete - cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:27:03 info: log_data_element: cib_update: + stonithd[6861]: 2007/09/19_16:27:08 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6861]: 2007/09/19_16:27:08 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6877]: 2007/09/19_16:27:13 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6877]: 2007/09/19_16:27:13 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6893]: 2007/09/19_16:27:18 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6893]: 2007/09/19_16:27:18 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6909]: 2007/09/19_16:27:23 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6909]: 2007/09/19_16:27:23 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:27:25 WARN: Performed 2 more non-realtime malloc calls. stonithd[4001]: 2007/09/19_16:27:25 info: Total non-realtime malloc bytes: 274432 stonithd[6925]: 2007/09/19_16:27:29 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6925]: 2007/09/19_16:27:29 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6941]: 2007/09/19_16:27:34 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6941]: 2007/09/19_16:27:34 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6957]: 2007/09/19_16:27:39 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6957]: 2007/09/19_16:27:39 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6973]: 2007/09/19_16:27:44 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6973]: 2007/09/19_16:27:44 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[6989]: 2007/09/19_16:27:49 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[6989]: 2007/09/19_16:27:49 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7005]: 2007/09/19_16:27:54 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7005]: 2007/09/19_16:27:54 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7021]: 2007/09/19_16:27:59 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7021]: 2007/09/19_16:27:59 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7039]: 2007/09/19_16:28:04 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7039]: 2007/09/19_16:28:04 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7055]: 2007/09/19_16:28:09 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7055]: 2007/09/19_16:28:09 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7071]: 2007/09/19_16:28:14 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7071]: 2007/09/19_16:28:14 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7087]: 2007/09/19_16:28:19 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7087]: 2007/09/19_16:28:19 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7106]: 2007/09/19_16:28:24 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7106]: 2007/09/19_16:28:24 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_16:28:26 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 ERROR: log_data_element: cib_process_change: CIB Update failures cib[3999]: 2007/09/19_16:28:26 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[3999]: 2007/09/19_16:28:26 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[3999]: 2007/09/19_16:28:26 info: crm_log_message_adv: #========= Input message message start ==========# cib[3999]: 2007/09/19_16:28:26 info: MSG: Dumping message with 9 fields cib[3999]: 2007/09/19_16:28:26 info: MSG[0] : [__name__=cib_command] cib[3999]: 2007/09/19_16:28:26 info: MSG[1] : [t=cib] cib[3999]: 2007/09/19_16:28:26 info: MSG[2] : [cib_op=cib_create] cib[3999]: 2007/09/19_16:28:26 info: MSG[3] : [cib_section=resources] cib[3999]: 2007/09/19_16:28:26 info: MSG[4] : [cib_callid=2] cib[3999]: 2007/09/19_16:28:26 info: MSG[5] : [cib_callopt=0] cib[3999]: 2007/09/19_16:28:26 info: MSG[6] : [(2)cib_calldata=0x8c37a18(1138 1418)] cib[3999]: 2007/09/19_16:28:26 info: cib[3999]: 2007/09/19_16:28:26 info: MSG[7] : [cib_clientid=e1b0488e-acf0-4a94-a2f6-fe893dd53aa8] cib[3999]: 2007/09/19_16:28:26 info: MSG[8] : [cib_clientname=7107] cib[3999]: 2007/09/19_16:28:26 info: cib_stats: Processed 67 operations (13880.00us average, 0% utilization) in the last 10min stonithd[7124]: 2007/09/19_16:28:29 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7124]: 2007/09/19_16:28:30 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7140]: 2007/09/19_16:28:35 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7140]: 2007/09/19_16:28:35 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7156]: 2007/09/19_16:28:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7156]: 2007/09/19_16:28:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_delete: Diff: --- 0.10.6 cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_delete: Diff: +++ 0.11.1 cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - tengine[4069]: 2007/09/19_16:28:44 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - crmd[4003]: 2007/09/19_16:28:44 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - crmd[4003]: 2007/09/19_16:28:44 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_16:28:44 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: unpack_config: On loss of CCM Quorum: Ignore cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - crmd[4003]: 2007/09/19_16:28:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:28:44 info: unpack_graph: Unpacked transition 5: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:28:44 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - tengine[4069]: 2007/09/19_16:28:44 info: send_rsc_command: Initiating action 32: child_DoFencing:0_stop_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - crmd[4003]: 2007/09/19_16:28:44 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_stop_0 key=32:5:a38b4c13-e34c-4084-9370-1d4f139bb940) pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - crmd[4003]: 2007/09/19_16:28:44 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_5000 (call=33, rc=-2) Cancelled pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:0 running on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: + pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: process_orphan_resource: Making sure orphan child_DoFencing:0 is stopped pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: process_orphan_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:1 running on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: log_data_element: create_fake_resource: Orphan resource pengine[4070]: 2007/09/19_16:28:44 info: process_orphan_resource: Making sure orphan child_DoFencing:1 is stopped pengine[4070]: 2007/09/19_16:28:44 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:28:44 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:44 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:44 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed pengine[4070]: 2007/09/19_16:28:44 info: native_print: child_DoFencing:0 (stonith:apcsnmp ORPHANED): Started host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_delete: Diff: --- 0.11.1 pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_delete: Diff: +++ 0.11.2 pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: native_color: Stopping orphan resource child_DoFencing:0 cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 notice: StopRsc: host-1.awale.qc.ca Stop child_DoFencing:0 cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: native_color: Stopping orphan resource child_DoFencing:1 cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - pengine[4070]: 2007/09/19_16:28:44 info: process_pe_message: Transition 5: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-53.bz2 cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - lrmd[7174]: 2007/09/19_16:28:44 info: Try to stop STONITH resource : Device=apcsnmp pengine[4070]: 2007/09/19_16:28:44 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_delete: + cib[7172]: 2007/09/19_16:28:44 info: write_cib_contents: Wrote version 0.11.1 of the CIB to disk (digest: 3fc39e7a04fae84cb993f2b8396b421d) crmd[4003]: 2007/09/19_16:28:44 info: process_lrm_event: LRM operation child_DoFencing:0_stop_0 (call=34, rc=0) complete cibmon[3997]: 2007/09/19_16:28:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[4003]: 2007/09/19_16:28:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:28:44 info: match_graph_event: Action child_DoFencing:0_stop_0 (32) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_update: Diff: --- 0.11.2 tengine[4069]: 2007/09/19_16:28:44 info: run_graph: Transition 5: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_16:28:44 info: log_cib_diff: cib_update: Diff: +++ 0.11.3 tengine[4069]: 2007/09/19_16:28:44 info: notify_crmd: Transition 5 status: te_complete - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:44 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_create: Diff: --- 0.11.3 cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_create: Diff: +++ 0.12.1 cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: - tengine[4069]: 2007/09/19_16:28:47 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: - crmd[4003]: 2007/09/19_16:28:47 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + crmd[4003]: 2007/09/19_16:28:47 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_create: + cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 notice: unpack_config: On loss of CCM Quorum: Ignore cib[3999]: 2007/09/19_16:28:47 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:28:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:28:47 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:28:47 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:28:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:28:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:28:47 info: unpack_graph: Unpacked transition 6: 4 actions in 4 synapses pengine[4070]: 2007/09/19_16:28:47 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_16:28:47 info: te_pseudo_action: Pseudo action 33 fired and confirmed pengine[4070]: 2007/09/19_16:28:47 info: clone_print: Clone Set: DoFencing crmd[4003]: 2007/09/19_16:28:47 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=31:6:a38b4c13-e34c-4084-9370-1d4f139bb940) tengine[4069]: 2007/09/19_16:28:47 info: send_rsc_command: Initiating action 31: child_DoFencing:0_start_0 on host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:28:47 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:28:47 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped lrmd[7178]: 2007/09/19_16:28:47 info: Try to start STONITH resource : Device=apcsnmp pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:28:47 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:28:47 notice: StartRsc: host-1.awale.qc.ca Start child_DoFencing:0 pengine[4070]: 2007/09/19_16:28:47 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_50000 pengine[4070]: 2007/09/19_16:28:47 WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-152.bz2 pengine[4070]: 2007/09/19_16:28:47 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[7177]: 2007/09/19_16:28:47 info: write_cib_contents: Wrote version 0.12.1 of the CIB to disk (digest: d7d085c3f34ed04553a6629eef15b7e9) stonithd[7180]: 2007/09/19_16:28:47 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7180]: 2007/09/19_16:28:47 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_16:28:47 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=35, rc=0) complete crmd[4003]: 2007/09/19_16:28:47 info: build_operation_update: Digest for 0:0;31:6:a38b4c13-e34c-4084-9370-1d4f139bb940 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[4003]: 2007/09/19_16:28:47 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_16:28:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed stonithd[4001]: 2007/09/19_16:28:47 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_update: Diff: --- 0.12.1 cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_update: Diff: +++ 0.12.2 cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:28:47 info: match_graph_event: Action child_DoFencing:0_start_0 (31) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:28:47 info: send_rsc_command: Initiating action 32: child_DoFencing:0_monitor_50000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_16:28:47 info: te_pseudo_action: Pseudo action 34 fired and confirmed cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_16:28:47 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_50000 key=32:6:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + stonithd[4001]: 2007/09/19_16:28:47 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:28:47 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 620 ms (> 30 ms) (GSource: 0x98fccf0) stonithd[7182]: 2007/09/19_16:28:47 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7182]: 2007/09/19_16:28:47 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_16:28:47 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=36, rc=0) complete cibmon[3997]: 2007/09/19_16:28:47 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_16:28:47 info: match_graph_event: Action child_DoFencing:0_monitor_50000 (32) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_update: Diff: --- 0.12.2 tengine[4069]: 2007/09/19_16:28:47 info: run_graph: Transition 6: (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_16:28:47 info: log_cib_diff: cib_update: Diff: +++ 0.12.3 tengine[4069]: 2007/09/19_16:28:47 info: notify_crmd: Transition 6 status: te_complete - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_16:28:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_16:28:47 info: log_data_element: cib_update: + stonithd[4001]: 2007/09/19_16:29:25 WARN: Performed 2 more non-realtime malloc calls. stonithd[4001]: 2007/09/19_16:29:25 info: Total non-realtime malloc bytes: 548864 stonithd[7413]: 2007/09/19_16:29:38 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7413]: 2007/09/19_16:29:38 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7555]: 2007/09/19_16:30:28 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7555]: 2007/09/19_16:30:28 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7784]: 2007/09/19_16:31:18 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7784]: 2007/09/19_16:31:18 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[7928]: 2007/09/19_16:32:08 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7928]: 2007/09/19_16:32:08 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8151]: 2007/09/19_16:32:58 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8151]: 2007/09/19_16:32:58 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8301]: 2007/09/19_16:33:48 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8301]: 2007/09/19_16:33:48 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8443]: 2007/09/19_16:34:38 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8443]: 2007/09/19_16:34:38 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8674]: 2007/09/19_16:35:28 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8674]: 2007/09/19_16:35:28 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8816]: 2007/09/19_16:36:18 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8816]: 2007/09/19_16:36:18 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[9031]: 2007/09/19_16:37:08 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9031]: 2007/09/19_16:37:08 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[9176]: 2007/09/19_16:37:58 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9176]: 2007/09/19_16:37:58 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_16:38:26 info: cib_stats: Processed 9 operations (18888.00us average, 0% utilization) in the last 10min stonithd[9318]: 2007/09/19_16:38:48 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9318]: 2007/09/19_16:38:48 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[9547]: 2007/09/19_16:39:38 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9547]: 2007/09/19_16:39:38 info: 10.0.0.166 has sysName 'RackPDU Archivage' lrmd[4000]: 2007/09/19_16:39:39 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1010 ms (> 100 ms) before being called (GSource: 0x8a51298) lrmd[4000]: 2007/09/19_16:39:39 info: G_SIG_dispatch: started at 429548377 should have started at 429548276 stonithd[9689]: 2007/09/19_16:40:29 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9689]: 2007/09/19_16:40:30 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[9920]: 2007/09/19_16:41:20 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9920]: 2007/09/19_16:41:20 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10062]: 2007/09/19_16:42:10 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10062]: 2007/09/19_16:42:10 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10283]: 2007/09/19_16:43:00 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10283]: 2007/09/19_16:43:00 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10425]: 2007/09/19_16:43:50 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10425]: 2007/09/19_16:43:50 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10571]: 2007/09/19_16:44:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10571]: 2007/09/19_16:44:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10800]: 2007/09/19_16:45:30 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10800]: 2007/09/19_16:45:30 info: 10.0.0.166 has sysName 'RackPDU Archivage' lrmd[4000]: 2007/09/19_16:46:11 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x8a51298) lrmd[4000]: 2007/09/19_16:46:11 info: G_SIG_dispatch: started at 429587490 should have started at 429587390 stonithd[10928]: 2007/09/19_16:46:20 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10928]: 2007/09/19_16:46:20 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[11159]: 2007/09/19_16:47:10 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[11159]: 2007/09/19_16:47:10 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[11308]: 2007/09/19_16:48:00 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[11308]: 2007/09/19_16:48:00 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_16:48:26 info: cib_stats: Processed 5 operations (4000.00us average, 0% utilization) in the last 10min stonithd[11457]: 2007/09/19_16:48:50 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[11457]: 2007/09/19_16:48:50 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[11698]: 2007/09/19_16:49:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[11698]: 2007/09/19_16:49:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[11834]: 2007/09/19_16:50:31 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[11834]: 2007/09/19_16:50:31 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_16:50:34 info: handle_request: Current ping state: S_IDLE crmd[4003]: 2007/09/19_16:50:41 info: handle_request: Current ping state: S_IDLE stonithd[12073]: 2007/09/19_16:51:21 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12073]: 2007/09/19_16:51:21 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[12220]: 2007/09/19_16:52:11 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12220]: 2007/09/19_16:52:11 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[12457]: 2007/09/19_16:53:01 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12457]: 2007/09/19_16:53:01 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[12601]: 2007/09/19_16:53:51 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12601]: 2007/09/19_16:53:51 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[12739]: 2007/09/19_16:54:41 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12739]: 2007/09/19_16:54:41 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[12968]: 2007/09/19_16:55:31 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[12968]: 2007/09/19_16:55:31 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_16:55:41 ERROR: cib_process_modify: Cannot perform modification with no data cib[3999]: 2007/09/19_16:55:41 WARN: do_cib_notify: Operation cib_modify (on section=cib) FAILED: (-25) The update was empty cib[3999]: 2007/09/19_16:55:41 ERROR: cib_process_request: cib_modify operation failed: The update was empty cib[3999]: 2007/09/19_16:55:41 info: crm_log_message_adv: #========= Input message message start ==========# cib[3999]: 2007/09/19_16:55:41 info: MSG: Dumping message with 7 fields cib[3999]: 2007/09/19_16:55:41 info: MSG[0] : [__name__=cib_command] cib[3999]: 2007/09/19_16:55:41 info: MSG[1] : [t=cib] cib[3999]: 2007/09/19_16:55:41 info: MSG[2] : [cib_op=cib_modify] cib[3999]: 2007/09/19_16:55:41 info: MSG[3] : [cib_callid=2] cib[3999]: 2007/09/19_16:55:41 info: MSG[4] : [cib_callopt=0] cib[3999]: 2007/09/19_16:55:41 info: MSG[5] : [cib_clientid=948ca147-14d6-42af-bef6-422f998702eb] cib[3999]: 2007/09/19_16:55:41 info: MSG[6] : [cib_clientname=12997] cib[3999]: 2007/09/19_16:56:01 WARN: do_cib_notify: cib_modify of FAILED: The object/attribute does not exist cib[3999]: 2007/09/19_16:56:01 ERROR: cib_process_request: cib_modify operation failed: The object/attribute does not exist cib[3999]: 2007/09/19_16:56:01 info: crm_log_message_adv: #========= Input message message start ==========# cib[3999]: 2007/09/19_16:56:01 info: MSG: Dumping message with 8 fields cib[3999]: 2007/09/19_16:56:01 info: MSG[0] : [__name__=cib_command] cib[3999]: 2007/09/19_16:56:01 info: MSG[1] : [t=cib] cib[3999]: 2007/09/19_16:56:01 info: MSG[2] : [cib_op=cib_modify] cib[3999]: 2007/09/19_16:56:01 info: MSG[3] : [cib_callid=2] cib[3999]: 2007/09/19_16:56:01 info: MSG[4] : [cib_callopt=0] cib[3999]: 2007/09/19_16:56:01 info: MSG[5] : [(2)cib_calldata=0x8cb3df0(93 109)] cib[3999]: 2007/09/19_16:56:01 info: cib[3999]: 2007/09/19_16:56:01 info: MSG[6] : [cib_clientid=40f86358-14c2-46c2-a021-6d207e0cfd21] cib[3999]: 2007/09/19_16:56:01 info: MSG[7] : [cib_clientname=13055] stonithd[13131]: 2007/09/19_16:56:21 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[13131]: 2007/09/19_16:56:21 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[3997]: 2007/09/19_16:56:50 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_16:56:50 info: log_cib_diff: cib_modify: Diff: --- 0.12.3 tengine[4069]: 2007/09/19_16:56:50 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:56:50 info: log_cib_diff: cib_modify: Diff: +++ 0.13.1 cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - crmd[4003]: 2007/09/19_16:56:50 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - crmd[4003]: 2007/09/19_16:56:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_16:56:50 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:56:50 info: log_data_element: cib:diff: + pengine[4070]: 2007/09/19_16:56:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:56:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:56:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:56:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:56:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:56:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:56:50 info: determine_online_status: Node host-1.awale.qc.ca is online cib[13221]: 2007/09/19_16:56:50 info: write_cib_contents: Wrote version 0.13.1 of the CIB to disk (digest: 0867e509b252ae058c314789b3bf57c0) stonithd[4001]: 2007/09/19_16:56:50 info: client tengine [pid: 4069] want a STONITH operation RESET to node host-2.awale.qc.ca. crmd[4003]: 2007/09/19_16:56:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:56:50 info: unpack_graph: Unpacked transition 7: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:56:50 info: group_print: Resource Group: group-DW stonithd[4001]: 2007/09/19_16:56:50 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:56:50 info: te_fence_node: Executing reboot fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:56:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:56:50 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:56:50 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:56:50 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:56:50 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:56:50 WARN: process_pe_message: Transition 7: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-153.bz2 pengine[4070]: 2007/09/19_16:56:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[13375]: 2007/09/19_16:57:11 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[13375]: 2007/09/19_16:57:11 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:57:20 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=RESET, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:57:20 info: tengine_stonith_callback: call=-2, optype=1, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:7:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_16:57:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:57:20 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_16:57:20 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:57:20 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_16:57:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_16:57:20 info: run_graph: Transition 7: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_16:57:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:57:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:57:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:57:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:57:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:57:20 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:57:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:57:20 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:57:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:57:20 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:20 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_16:57:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:57:20 info: unpack_graph: Unpacked transition 8: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_16:57:20 info: client tengine [pid: 4069] want a STONITH operation RESET to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:57:20 info: te_fence_node: Executing reboot fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:57:20 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere stonithd[4001]: 2007/09/19_16:57:20 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:57:20 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:20 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:57:20 WARN: process_pe_message: Transition 8: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-154.bz2 pengine[4070]: 2007/09/19_16:57:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[3997]: 2007/09/19_16:57:37 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_16:57:37 info: log_cib_diff: cib_modify: Local-only Change: 0.14.1 cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - tengine[4069]: 2007/09/19_16:57:37 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - tengine[4069]: 2007/09/19_16:57:37 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_16:57:37 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[3999]: 2007/09/19_16:57:37 info: log_data_element: cib:diff: + cib[13449]: 2007/09/19_16:57:37 info: write_cib_contents: Wrote version 0.14.1 of the CIB to disk (digest: b399f609024cc49a4368ec30d6505917) stonithd[4001]: 2007/09/19_16:57:50 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=RESET, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:57:50 info: tengine_stonith_callback: call=-3, optype=1, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:8:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_16:57:50 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. tengine[4069]: 2007/09/19_16:57:50 info: run_graph: Transition 8: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) crmd[4003]: 2007/09/19_16:57:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[4003]: 2007/09/19_16:57:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[4070]: 2007/09/19_16:57:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:57:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:57:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:57:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:57:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:57:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:57:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:57:50 info: group_print: Resource Group: group-DW crmd[4003]: 2007/09/19_16:57:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:57:50 info: unpack_graph: Unpacked transition 9: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:57:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_16:57:50 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:57:50 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:57:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_16:57:50 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:57:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:57:50 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:57:50 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:57:50 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:57:50 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:57:50 WARN: process_pe_message: Transition 9: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-155.bz2 pengine[4070]: 2007/09/19_16:57:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[13526]: 2007/09/19_16:58:01 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[13526]: 2007/09/19_16:58:01 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:58:20 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:58:20 info: tengine_stonith_callback: call=-4, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:9:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_16:58:20 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_16:58:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:58:20 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_16:58:20 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:58:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_16:58:20 info: run_graph: Transition 9: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_16:58:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:58:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:58:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:58:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:58:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:58:20 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:58:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:58:20 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:58:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:58:20 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:20 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_16:58:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:58:20 info: unpack_graph: Unpacked transition 10: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_16:58:20 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:58:20 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:58:20 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere stonithd[4001]: 2007/09/19_16:58:20 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:58:20 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:20 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:58:20 WARN: process_pe_message: Transition 10: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-156.bz2 pengine[4070]: 2007/09/19_16:58:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[3999]: 2007/09/19_16:58:26 info: cib_stats: Processed 17 operations (8823.00us average, 0% utilization) in the last 10min stonithd[4001]: 2007/09/19_16:58:50 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:58:50 info: tengine_stonith_callback: call=-5, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:10:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_16:58:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:58:50 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_16:58:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:58:50 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_16:58:50 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_16:58:50 info: run_graph: Transition 10: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_16:58:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:58:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:58:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:58:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:58:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:58:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:58:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:58:50 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:58:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:58:50 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:58:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:58:50 info: clone_print: Clone Set: DoFencing tengine[4069]: 2007/09/19_16:58:50 info: unpack_graph: Unpacked transition 11: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:58:50 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_16:58:50 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:58:50 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:58:50 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped stonithd[4001]: 2007/09/19_16:58:50 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:58:50 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:58:50 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:58:50 WARN: process_pe_message: Transition 11: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-157.bz2 pengine[4070]: 2007/09/19_16:58:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[13681]: 2007/09/19_16:58:51 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[13681]: 2007/09/19_16:58:51 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:59:20 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:59:20 info: tengine_stonith_callback: call=-6, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:11:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_16:59:20 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_16:59:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:59:20 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_16:59:20 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:59:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_16:59:20 info: run_graph: Transition 11: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_16:59:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:59:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:59:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:59:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:59:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:59:20 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:59:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:59:20 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:59:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_16:59:20 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:20 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_16:59:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:59:20 info: unpack_graph: Unpacked transition 12: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_16:59:20 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_16:59:20 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_16:59:20 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:20 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:59:20 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:20 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:59:20 WARN: process_pe_message: Transition 12: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-158.bz2 pengine[4070]: 2007/09/19_16:59:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[13883]: 2007/09/19_16:59:41 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[13883]: 2007/09/19_16:59:41 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_16:59:50 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_16:59:50 info: tengine_stonith_callback: call=-7, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:12:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_16:59:50 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_16:59:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_16:59:50 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_16:59:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_16:59:50 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_16:59:50 info: run_graph: Transition 12: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_16:59:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_16:59:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_16:59:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_16:59:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_16:59:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_16:59:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_16:59:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_16:59:50 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_16:59:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca crmd[4003]: 2007/09/19_16:59:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_16:59:50 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_16:59:50 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:59:50 info: unpack_graph: Unpacked transition 13: 1 actions in 1 synapses pengine[4070]: 2007/09/19_16:59:50 info: clone_print: Clone Set: DoFencing stonithd[4001]: 2007/09/19_16:59:50 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_16:59:50 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_16:59:50 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_16:59:50 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_16:59:50 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_16:59:50 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_16:59:50 WARN: process_pe_message: Transition 13: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-159.bz2 pengine[4070]: 2007/09/19_16:59:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[4001]: 2007/09/19_17:00:20 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT crmd[4003]: 2007/09/19_17:00:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:00:20 info: tengine_stonith_callback: call=-8, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:13:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_17:00:20 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:00:20 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. tengine[4069]: 2007/09/19_17:00:20 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:00:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:00:20 info: run_graph: Transition 13: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:00:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:00:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:00:20 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:00:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:00:20 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:00:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[4003]: 2007/09/19_17:00:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:00:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:00:20 info: unpack_graph: Unpacked transition 14: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:00:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:00:20 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_17:00:20 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:00:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:00:20 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:00:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:20 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:20 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:20 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:00:20 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:20 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:00:20 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:20 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:00:20 WARN: process_pe_message: Transition 14: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-160.bz2 pengine[4070]: 2007/09/19_17:00:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[14027]: 2007/09/19_17:00:31 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[14027]: 2007/09/19_17:00:31 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_17:00:50 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:00:50 info: tengine_stonith_callback: call=-9, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:14:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_17:00:50 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. tengine[4069]: 2007/09/19_17:00:50 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:00:50 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[4003]: 2007/09/19_17:00:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:00:50 info: run_graph: Transition 14: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) crmd[4003]: 2007/09/19_17:00:50 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[4070]: 2007/09/19_17:00:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:00:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:00:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:00:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:00:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:00:50 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:00:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:00:50 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:00:50 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:00:50 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:00:50 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_17:00:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_17:00:50 info: unpack_graph: Unpacked transition 15: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_17:00:50 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:00:50 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:00:50 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere stonithd[4001]: 2007/09/19_17:00:50 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:00:50 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:00:50 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:00:50 WARN: process_pe_message: Transition 15: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-161.bz2 pengine[4070]: 2007/09/19_17:00:50 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[4001]: 2007/09/19_17:01:20 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:01:21 info: tengine_stonith_callback: call=-10, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:15:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_17:01:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:01:21 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_17:01:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:01:21 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:01:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:01:21 info: run_graph: Transition 15: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:01:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:01:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:01:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:01:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:01:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:01:21 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:01:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:01:21 info: group_print: Resource Group: group-DW crmd[4003]: 2007/09/19_17:01:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:01:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:01:21 info: unpack_graph: Unpacked transition 16: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:01:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:01:21 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_17:01:21 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:01:21 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:01:21 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:01:21 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:01:21 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:21 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:01:21 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:21 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:01:21 WARN: process_pe_message: Transition 16: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-162.bz2 pengine[4070]: 2007/09/19_17:01:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[3997]: 2007/09/19_17:01:22 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - tengine[4069]: 2007/09/19_17:01:22 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_17:01:22 info: log_cib_diff: cib_delete: Local-only Change: 0.15.1 cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - tengine[4069]: 2007/09/19_17:01:22 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cib[3999]: 2007/09/19_17:01:22 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:01:22 info: log_data_element: cib_delete: + stonithd[14263]: 2007/09/19_17:01:22 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cib[14264]: 2007/09/19_17:01:22 info: write_cib_contents: Wrote version 0.15.1 of the CIB to disk (digest: e859708ab0a7053bf5fd360fae357cc5) stonithd[14263]: 2007/09/19_17:01:22 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_17:01:51 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:01:51 info: tengine_stonith_callback: call=-11, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:16:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_17:01:51 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_17:01:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:01:51 info: run_graph: Transition 16: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) crmd[4003]: 2007/09/19_17:01:51 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[4070]: 2007/09/19_17:01:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:01:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:01:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:01:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:01:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:01:51 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:01:51 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:01:51 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:01:51 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:01:51 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:01:51 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_17:01:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_17:01:51 info: unpack_graph: Unpacked transition 17: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:01:51 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_17:01:51 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:01:51 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:51 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:01:51 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:01:51 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:01:51 WARN: process_pe_message: Transition 17: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-163.bz2 pengine[4070]: 2007/09/19_17:01:51 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[14408]: 2007/09/19_17:02:12 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[14408]: 2007/09/19_17:02:12 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_17:02:21 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:02:21 info: tengine_stonith_callback: call=-12, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:17:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_17:02:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:02:21 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_17:02:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:02:21 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:02:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:02:21 info: run_graph: Transition 17: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:02:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:02:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:02:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:02:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:02:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:02:21 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:02:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:02:21 info: group_print: Resource Group: group-DW crmd[4003]: 2007/09/19_17:02:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:02:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:02:21 info: unpack_graph: Unpacked transition 18: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:02:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:02:21 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:02:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:02:21 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:02:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca stonithd[4001]: 2007/09/19_17:02:21 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:02:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:21 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:21 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:21 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:02:21 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:21 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:02:21 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:21 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:02:21 WARN: process_pe_message: Transition 18: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-164.bz2 pengine[4070]: 2007/09/19_17:02:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[4001]: 2007/09/19_17:02:51 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:02:51 info: tengine_stonith_callback: call=-13, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:18:a38b4c13-e34c-4084-9370-1d4f139bb940 crmd[4003]: 2007/09/19_17:02:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:02:51 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. crmd[4003]: 2007/09/19_17:02:51 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:02:51 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:02:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:02:51 info: run_graph: Transition 18: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:02:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:02:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:02:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:02:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:02:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:02:51 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:02:51 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:02:51 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:02:51 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:02:51 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:02:51 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_17:02:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_17:02:51 info: unpack_graph: Unpacked transition 19: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:02:51 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. tengine[4069]: 2007/09/19_17:02:51 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:02:51 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:51 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:02:51 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:02:51 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:02:51 WARN: process_pe_message: Transition 19: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-165.bz2 pengine[4070]: 2007/09/19_17:02:51 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[14651]: 2007/09/19_17:03:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[14651]: 2007/09/19_17:03:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[4001]: 2007/09/19_17:03:21 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT tengine[4069]: 2007/09/19_17:03:21 info: tengine_stonith_callback: call=-14, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:19:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_17:03:21 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. tengine[4069]: 2007/09/19_17:03:21 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_17:03:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:03:21 info: run_graph: Transition 19: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) crmd[4003]: 2007/09/19_17:03:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[4003]: 2007/09/19_17:03:21 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[4070]: 2007/09/19_17:03:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:03:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:03:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:03:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:03:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:03:21 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:03:21 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[4003]: 2007/09/19_17:03:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:03:21 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:03:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:03:21 info: unpack_graph: Unpacked transition 20: 1 actions in 1 synapses pengine[4070]: 2007/09/19_17:03:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:03:21 info: te_fence_node: Executing poweroff fencing operation (38) on host-2.awale.qc.ca (timeout=30000) pengine[4070]: 2007/09/19_17:03:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:03:21 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:21 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:03:21 info: client tengine [pid: 4069] want a STONITH operation POWEROFF to node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) stonithd[4001]: 2007/09/19_17:03:21 info: Broadcasting the message succeeded: require others to stonith node host-2.awale.qc.ca. pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:03:21 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:21 WARN: stage6: Scheduling Node host-2.awale.qc.ca for STONITH pengine[4070]: 2007/09/19_17:03:21 WARN: process_pe_message: Transition 20: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-166.bz2 pengine[4070]: 2007/09/19_17:03:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[3238]: 2007/09/19_17:03:23 info: Link host-2.awale.qc.ca:eth0 up. crmd[4003]: 2007/09/19_17:03:23 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] heartbeat[3238]: 2007/09/19_17:03:23 info: Status update for node host-2.awale.qc.ca: status init crmd[4003]: 2007/09/19_17:03:23 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[3238]: 2007/09/19_17:03:23 info: Status update for node host-2.awale.qc.ca: status up heartbeat[3238]: 2007/09/19_17:03:23 info: all clients are now paused crmd[4003]: 2007/09/19_17:03:24 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] heartbeat[3238]: 2007/09/19_17:03:24 info: Status update for node host-2.awale.qc.ca: status active cib[3999]: 2007/09/19_17:03:25 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[3238]: 2007/09/19_17:03:29 info: all clients are now resumed heartbeat[3238]: 2007/09/19_17:03:29 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [14:16] heartbeat[3238]: 2007/09/19_17:03:29 info: No pkts missing from host-2.awale.qc.ca! crmd[4003]: 2007/09/19_17:03:29 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[3997]: 2007/09/19_17:03:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:29 info: log_cib_diff: cib_update: Local-only Change: 0.15.1 cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:29 info: log_cib_diff: cib_update: Local-only Change: 0.15.1 cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:29 info: log_data_element: cib_update: + heartbeat[3238]: 2007/09/19_17:03:30 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [18:20] heartbeat[3238]: 2007/09/19_17:03:30 info: No pkts missing from host-2.awale.qc.ca! cib[3999]: 2007/09/19_17:03:31 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[4003]: 2007/09/19_17:03:31 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[3999]: 2007/09/19_17:03:31 info: mem_handle_event: no mbr_track info crmd[4003]: 2007/09/19_17:03:31 info: mem_handle_event: no mbr_track info cib[3999]: 2007/09/19_17:03:31 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[4003]: 2007/09/19_17:03:31 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[3999]: 2007/09/19_17:03:31 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[4003]: 2007/09/19_17:03:31 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[3999]: 2007/09/19_17:03:31 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[4003]: 2007/09/19_17:03:31 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) cib[3999]: 2007/09/19_17:03:31 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:03:31 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[4003]: 2007/09/19_17:03:31 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[4003]: 2007/09/19_17:03:31 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=2] crmd[4003]: 2007/09/19_17:03:31 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[3997]: 2007/09/19_17:03:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:31 info: log_cib_diff: cib_update: Local-only Change: 0.15.1 cibmon[3997]: 2007/09/19_17:03:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:31 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:03:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[4003]: 2007/09/19_17:03:34 info: update_dc: Set DC to () crmd[4003]: 2007/09/19_17:03:34 info: join_make_offer: Making join offers based on membership 2 crmd[4003]: 2007/09/19_17:03:34 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks tengine[4069]: 2007/09/19_17:03:34 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_17:03:34 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_17:03:35 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[4003]: 2007/09/19_17:03:35 info: do_state_transition: All 2 cluster nodes responded to the join offer. crmd[4003]: 2007/09/19_17:03:35 WARN: do_dc_join_finalize: join-2: We are still in a transition. Delaying until the TE completes. crmd[4003]: 2007/09/19_17:03:35 WARN: do_dc_join_finalize: join-2: We are still in a transition. Delaying until the TE completes. stonithd[4001]: 2007/09/19_17:03:51 ERROR: Failed to STONITH the node host-2.awale.qc.ca: optype=POWEROFF, op_result=TIMEOUT attrd[4002]: 2007/09/19_17:03:51 info: attrd_local_callback: Sending full refresh tengine[4069]: 2007/09/19_17:03:51 info: tengine_stonith_callback: call=-15, optype=3, node_name=host-2.awale.qc.ca, result=2, node_list=, action=38:20:a38b4c13-e34c-4084-9370-1d4f139bb940 tengine[4069]: 2007/09/19_17:03:51 ERROR: tengine_stonith_callback: Stonith of host-2.awale.qc.ca failed (2)... aborting transition. cib[3999]: 2007/09/19_17:03:51 info: sync_our_cib: Syncing CIB to all peers tengine[4069]: 2007/09/19_17:03:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[4069]: 2007/09/19_17:03:51 info: run_graph: Transition 20: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_17:03:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: --- 0.15.1 cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: +++ 0.15.2 cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: --- 0.15.2 cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: +++ 0.15.3 cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:51 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: --- 0.15.3 cibmon[3997]: 2007/09/19_17:03:51 info: log_cib_diff: cib_update: Diff: +++ 0.15.4 cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:51 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:03:51 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;4:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;16:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;6:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;14:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;31:6:a38b4c13-e34c-4084-9370-1d4f139bb940 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;8:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;10:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;28:3:a38b4c13-e34c-4084-9370-1d4f139bb940 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:03:51 info: build_operation_update: Digest for 0:0;12:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[4003]: 2007/09/19_17:03:51 info: log_data_element: build_operation_update: digest:source stonithd[14786]: 2007/09/19_17:03:52 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[14786]: 2007/09/19_17:03:52 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_17:03:52 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:03:52 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:52 info: log_cib_diff: cib_update: Diff: --- 0.15.4 cibmon[3997]: 2007/09/19_17:03:52 info: log_cib_diff: cib_update: Diff: +++ 0.15.5 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:03:52 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[4003]: 2007/09/19_17:03:52 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_17:03:52 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:52 info: log_cib_diff: cib_update: Diff: --- 0.15.5 cibmon[3997]: 2007/09/19_17:03:52 info: log_cib_diff: cib_update: Diff: +++ 0.15.6 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action msg_first_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action msg_last_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action vmstat-mon_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action IPaddr_10_0_0_59_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action child_DoFencing:0_monitor_0 from a different transition: 4 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action share-drbd_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action child_DoFencing:1_monitor_0 from a different transition: 4 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action share-FS_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action mysql_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:52 info: process_graph_event: Detected action share-drbdlinks_monitor_0 from a different transition: 0 vs. 20 cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:52 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:03:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:03:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:03:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:03:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:03:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:03:53 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:03:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:03:53 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[4070]: 2007/09/19_17:03:53 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:03:53 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:03:53 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:03:53 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[4070]: 2007/09/19_17:03:53 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_17:03:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_17:03:53 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:03:53 notice: StartRsc: host-2.awale.qc.ca Start child_DoFencing:1 pengine[4070]: 2007/09/19_17:03:53 notice: RecurringOp: host-2.awale.qc.ca child_DoFencing:1_monitor_50000 crmd[4003]: 2007/09/19_17:03:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:03:53 info: unpack_graph: Unpacked transition 21: 19 actions in 19 synapses tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 12: msg_first_monitor_0 on host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:03:53 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=41:21:a38b4c13-e34c-4084-9370-1d4f139bb940) tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 13: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 14: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 15: share-FS_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 16: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 17: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 18: msg_last_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 19: mysql_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 41: mysql_stop_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 20: child_DoFencing:0_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:03:53 info: send_rsc_command: Initiating action 21: child_DoFencing:1_monitor_0 on host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:03:53 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=29, rc=-2) Cancelled cibmon[3997]: 2007/09/19_17:03:53 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_17:03:53 info: log_cib_diff: cib_delete: Diff: --- 0.15.6 cibmon[3997]: 2007/09/19_17:03:53 info: log_cib_diff: cib_delete: Diff: +++ 0.15.7 cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:03:53 info: log_data_element: cib_delete: + pengine[4070]: 2007/09/19_17:03:54 info: process_pe_message: Transition 21: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-54.bz2 cibmon[3997]: 2007/09/19_17:03:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:56 info: log_cib_diff: cib_update: Diff: --- 0.15.7 cibmon[3997]: 2007/09/19_17:03:56 info: log_cib_diff: cib_update: Diff: +++ 0.15.8 cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:56 info: match_graph_event: Action share-drbd_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:56 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:57 info: log_cib_diff: cib_update: Diff: --- 0.15.8 cibmon[3997]: 2007/09/19_17:03:57 info: log_cib_diff: cib_update: Diff: +++ 0.15.9 cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:57 info: match_graph_event: Action msg_first_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:57 info: log_cib_diff: cib_update: Diff: --- 0.15.9 cibmon[3997]: 2007/09/19_17:03:57 info: log_cib_diff: cib_update: Diff: +++ 0.15.10 cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:57 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:57 info: match_graph_event: Action vmstat-mon_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.10 tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action share-drbdlinks_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.11 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action share-FS_monitor_0 (15) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.11 cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.12 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action child_DoFencing:0_monitor_0 (20) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.12 cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.13 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.13 cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.14 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action msg_last_monitor_0 (18) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.14 tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (17) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.15 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: --- 0.15.15 cibmon[3997]: 2007/09/19_17:03:58 info: log_cib_diff: cib_update: Diff: +++ 0.15.16 cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:58 info: match_graph_event: Action mysql_monitor_0 (19) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:58 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:59 info: log_cib_diff: cib_update: Diff: --- 0.15.16 cibmon[3997]: 2007/09/19_17:03:59 info: log_cib_diff: cib_update: Diff: +++ 0.15.17 cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:59 info: match_graph_event: Action child_DoFencing:1_monitor_0 (21) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:59 info: send_rsc_command: Initiating action 11: probe_complete on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:59 info: te_pseudo_action: Pseudo action 10 fired and confirmed cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:59 info: te_pseudo_action: Pseudo action 48 fired and confirmed cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:03:59 info: send_rsc_command: Initiating action 46: child_DoFencing:1_start_0 on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + mysql[14795][14842]: 2007/09/19_17:03:59 INFO: MySQL stopped crmd[4003]: 2007/09/19_17:03:59 info: process_lrm_event: LRM operation mysql_stop_0 (call=37, rc=0) complete cibmon[3997]: 2007/09/19_17:03:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:03:59 info: log_cib_diff: cib_update: Diff: --- 0.15.17 cibmon[3997]: 2007/09/19_17:03:59 info: log_cib_diff: cib_update: Diff: +++ 0.15.18 cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:59 info: match_graph_event: Action mysql_stop_0 (41) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:03:59 info: send_rsc_command: Initiating action 42: mysql_start_0 on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:03:59 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_17:04:00 info: log_cib_diff: cib_modify: Diff: --- 0.15.18 cibmon[3997]: 2007/09/19_17:04:00 info: log_cib_diff: cib_modify: Diff: +++ 0.15.19 cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_17:04:00 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_17:04:00 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_17:04:00 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_17:04:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:04:00 info: log_cib_diff: cib_update: Diff: --- 0.15.19 cibmon[3997]: 2007/09/19_17:04:00 info: log_cib_diff: cib_update: Diff: +++ 0.15.20 cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:04:00 WARN: status_from_rc: Action start on host-2.awale.qc.ca failed (target: vs. rc: 1): Error cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:04:00 info: match_graph_event: Action child_DoFencing:1_start_0 (46) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:04:08 info: log_cib_diff: cib_update: Diff: --- 0.15.20 tengine[4069]: 2007/09/19_17:04:08 info: match_graph_event: Action mysql_start_0 (42) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:04:08 info: log_cib_diff: cib_update: Diff: +++ 0.15.21 tengine[4069]: 2007/09/19_17:04:08 info: run_graph: ==================================================== cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:04:08 notice: run_graph: Transition 21: (Complete=16, Pending=0, Fired=0, Skipped=2, Incomplete=1) cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:04:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:04:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:08 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:04:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:04:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:04:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:04:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[4003]: 2007/09/19_17:04:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:04:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:04:08 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:04:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:04:08 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[4070]: 2007/09/19_17:04:08 WARN: unpack_rsc_op: Processing failed op (child_DoFencing:1_start_0) on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 WARN: unpack_rsc_op: Handling failed start for child_DoFencing:1 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:04:08 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:04:08 info: unpack_graph: Unpacked transition 22: 4 actions in 4 synapses pengine[4070]: 2007/09/19_17:04:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:04:08 info: send_rsc_command: Initiating action 33: mysql_monitor_120000 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:04:08 info: te_pseudo_action: Pseudo action 38 fired and confirmed pengine[4070]: 2007/09/19_17:04:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:04:08 info: send_rsc_command: Initiating action 9: child_DoFencing:1_stop_0 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:04:08 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:04:08 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca FAILED pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_17:04:08 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:04:08 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:04:08 notice: StopRsc: host-2.awale.qc.ca Stop child_DoFencing:1 pengine[4070]: 2007/09/19_17:04:08 WARN: process_pe_message: Transition 22: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-167.bz2 pengine[4070]: 2007/09/19_17:04:08 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[3997]: 2007/09/19_17:04:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:04:10 info: log_cib_diff: cib_update: Diff: --- 0.15.21 cibmon[3997]: 2007/09/19_17:04:10 info: log_cib_diff: cib_update: Diff: +++ 0.15.22 cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:04:10 info: match_graph_event: Action child_DoFencing:1_stop_0 (9) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:04:10 info: te_pseudo_action: Pseudo action 39 fired and confirmed cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:04:10 info: log_cib_diff: cib_update: Diff: --- 0.15.22 cibmon[3997]: 2007/09/19_17:04:10 info: log_cib_diff: cib_update: Diff: +++ 0.15.23 cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:04:10 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:04:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:04:10 info: match_graph_event: Action mysql_monitor_120000 (33) confirmed on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:04:10 info: run_graph: Transition 22: (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[4069]: 2007/09/19_17:04:10 info: notify_crmd: Transition 22 status: te_complete - stonithd[14969]: 2007/09/19_17:04:42 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[14969]: 2007/09/19_17:04:42 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[15188]: 2007/09/19_17:05:32 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[15188]: 2007/09/19_17:05:32 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[15332]: 2007/09/19_17:06:22 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[15332]: 2007/09/19_17:06:22 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[15553]: 2007/09/19_17:07:12 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[15553]: 2007/09/19_17:07:12 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[15683]: 2007/09/19_17:08:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[15683]: 2007/09/19_17:08:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_17:08:26 info: cib_stats: Processed 60 operations (21500.00us average, 0% utilization) in the last 10min stonithd[15856]: 2007/09/19_17:08:52 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[15856]: 2007/09/19_17:08:52 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[16064]: 2007/09/19_17:09:43 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[16064]: 2007/09/19_17:09:43 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[16192]: 2007/09/19_17:10:33 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[16192]: 2007/09/19_17:10:33 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[16425]: 2007/09/19_17:11:23 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[16425]: 2007/09/19_17:11:23 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_17:11:25 info: handle_request: Current ping state: S_IDLE crmd[4003]: 2007/09/19_17:11:27 info: handle_request: Current ping state: S_IDLE crmd[4003]: 2007/09/19_17:11:50 info: handle_request: Current ping state: S_IDLE stonithd[16577]: 2007/09/19_17:12:13 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[16577]: 2007/09/19_17:12:13 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[4003]: 2007/09/19_17:12:22 info: handle_shutdown_request: Creating shutdown request for host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[4003]: 2007/09/19_17:12:22 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:12:22 info: extract_event: Aborting on shutdown attribute for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[3997]: 2007/09/19_17:12:22 info: log_cib_diff: cib_update: Diff: --- 0.15.23 crmd[4003]: 2007/09/19_17:12:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:12:22 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_17:12:22 info: log_cib_diff: cib_update: Diff: +++ 0.15.24 cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:22 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:12:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:12:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:12:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:12:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:12:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[4003]: 2007/09/19_17:12:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:12:22 info: unpack_graph: Unpacked transition 23: 4 actions in 4 synapses pengine[4070]: 2007/09/19_17:12:22 notice: unpack_config: On loss of CCM Quorum: Ignore tengine[4069]: 2007/09/19_17:12:22 info: send_rsc_command: Initiating action 31: mysql_stop_0 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:12:22 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[4070]: 2007/09/19_17:12:22 WARN: unpack_rsc_op: Processing failed op (child_DoFencing:1_start_0) on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 WARN: unpack_rsc_op: Handling failed start for child_DoFencing:1 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:12:22 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:12:22 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:12:22 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[4070]: 2007/09/19_17:12:22 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_17:12:22 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_17:12:22 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:12:22 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:12:22 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[4070]: 2007/09/19_17:12:22 WARN: process_pe_message: Transition 23: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-168.bz2 pengine[4070]: 2007/09/19_17:12:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[3997]: 2007/09/19_17:12:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_17:12:23 info: log_cib_diff: cib_delete: Diff: --- 0.15.24 cibmon[3997]: 2007/09/19_17:12:23 info: log_cib_diff: cib_delete: Diff: +++ 0.15.25 cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:12:23 info: log_data_element: cib_delete: + cibmon[3997]: 2007/09/19_17:12:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:12:27 info: log_cib_diff: cib_update: Diff: --- 0.15.25 cibmon[3997]: 2007/09/19_17:12:27 info: log_cib_diff: cib_update: Diff: +++ 0.15.26 crmd[4003]: 2007/09/19_17:12:27 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=32:23:a38b4c13-e34c-4084-9370-1d4f139bb940) tengine[4069]: 2007/09/19_17:12:27 info: match_graph_event: Action mysql_stop_0 (31) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:12:27 info: send_rsc_command: Initiating action 32: mysql_start_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:12:27 info: te_crm_command: Executing crm-event (40): do_shutdown on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:27 info: log_data_element: cib_update: + cib[3999]: 2007/09/19_17:12:28 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:12:28 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] cibmon[3997]: 2007/09/19_17:12:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:12:28 info: log_cib_diff: cib_update: Local-only Change: 0.15.26 cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:28 info: log_data_element: cib_update: + cib[3999]: 2007/09/19_17:12:29 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] cib[3999]: 2007/09/19_17:12:29 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[3999]: 2007/09/19_17:12:29 info: mem_handle_event: no mbr_track info cib[3999]: 2007/09/19_17:12:29 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[3999]: 2007/09/19_17:12:29 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[3999]: 2007/09/19_17:12:29 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca ccm[3998]: 2007/09/19_17:12:29 info: Break tie for 2 nodes cluster cib[3999]: 2007/09/19_17:12:29 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[4003]: 2007/09/19_17:12:29 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[4003]: 2007/09/19_17:12:29 info: mem_handle_event: no mbr_track info crmd[4003]: 2007/09/19_17:12:29 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[4003]: 2007/09/19_17:12:29 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[4003]: 2007/09/19_17:12:29 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=3) crmd[4003]: 2007/09/19_17:12:29 info: ccm_event_detail: NEW MEMBERSHIP: trans=3, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 crmd[4003]: 2007/09/19_17:12:29 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=3] crmd[4003]: 2007/09/19_17:12:29 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[3997]: 2007/09/19_17:12:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:12:29 info: log_cib_diff: cib_update: Local-only Change: 0.15.26 cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:29 info: log_data_element: cib_update: + mysql[16620][16686]: 2007/09/19_17:12:32 INFO: MySQL started crmd[4003]: 2007/09/19_17:12:32 info: process_lrm_event: LRM operation mysql_start_0 (call=38, rc=0) complete crmd[4003]: 2007/09/19_17:12:32 info: build_operation_update: Digest for 0:0;32:23:a38b4c13-e34c-4084-9370-1d4f139bb940 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[4003]: 2007/09/19_17:12:32 info: log_data_element: build_operation_update: digest:source cibmon[3997]: 2007/09/19_17:12:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:12:32 info: log_cib_diff: cib_update: Diff: --- 0.15.26 cibmon[3997]: 2007/09/19_17:12:32 info: log_cib_diff: cib_update: Diff: +++ 0.15.27 cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:12:32 info: match_graph_event: Action mysql_start_0 (32) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:12:32 info: send_rsc_command: Initiating action 33: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_17:12:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=33:23:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:12:32 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=39, rc=0) complete cibmon[3997]: 2007/09/19_17:12:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:12:32 info: log_cib_diff: cib_update: Diff: --- 0.15.27 cibmon[3997]: 2007/09/19_17:12:32 info: log_cib_diff: cib_update: Diff: +++ 0.15.28 cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:12:32 info: match_graph_event: Action mysql_monitor_120000 (33) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:12:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:12:32 info: run_graph: Transition 23: (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:12:32 info: notify_crmd: Transition 23 status: te_complete - cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:12:32 info: log_data_element: cib_update: + heartbeat[3238]: 2007/09/19_17:12:40 info: Link host-2.awale.qc.ca:eth0 dead. lrmd[4000]: 2007/09/19_17:12:49 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x8a51298) lrmd[4000]: 2007/09/19_17:12:49 info: G_SIG_dispatch: started at 429747286 should have started at 429747186 heartbeat[3238]: 2007/09/19_17:13:00 WARN: node host-2.awale.qc.ca: is dead crmd[4003]: 2007/09/19_17:13:00 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] cibmon[3997]: 2007/09/19_17:13:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_17:13:00 info: te_update_diff: Aborting on transient_attributes deletions tengine[4069]: 2007/09/19_17:13:00 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_17:13:00 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[4003]: 2007/09/19_17:13:00 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_17:13:00 info: log_cib_diff: cib_update: Local-only Change: 0.15.28 cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:00 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:13:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:13:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:13:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:13:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:13:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:13:00 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:13:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:13:00 WARN: unpack_rsc_op: Processing failed op (child_DoFencing:1_start_0) on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 WARN: unpack_rsc_op: Handling failed start for child_DoFencing:1 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:13:00 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:00 info: clone_print: Clone Set: DoFencing crmd[4003]: 2007/09/19_17:13:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:13:00 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:13:00 info: unpack_graph: Unpacked transition 24: 0 actions in 0 synapses pengine[4070]: 2007/09/19_17:13:00 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped crmd[4003]: 2007/09/19_17:13:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:13:00 info: run_graph: Transition 24: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) tengine[4069]: 2007/09/19_17:13:00 info: notify_crmd: Transition 24 status: te_complete - pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[4070]: 2007/09/19_17:13:00 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:00 WARN: process_pe_message: Transition 24: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-169.bz2 pengine[4070]: 2007/09/19_17:13:00 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[16861]: 2007/09/19_17:13:03 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[16861]: 2007/09/19_17:13:03 info: 10.0.0.166 has sysName 'RackPDU Archivage' heartbeat[3238]: 2007/09/19_17:13:12 info: Heartbeat restart on node host-2.awale.qc.ca heartbeat[3238]: 2007/09/19_17:13:12 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[3238]: 2007/09/19_17:13:12 info: Status update for node host-2.awale.qc.ca: status init heartbeat[3238]: 2007/09/19_17:13:12 info: Status update for node host-2.awale.qc.ca: status up crmd[4003]: 2007/09/19_17:13:12 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] crmd[4003]: 2007/09/19_17:13:12 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[3238]: 2007/09/19_17:13:14 info: Status update for node host-2.awale.qc.ca: status active crmd[4003]: 2007/09/19_17:13:14 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] cibmon[3997]: 2007/09/19_17:13:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:14 info: log_cib_diff: cib_update: Local-only Change: 0.15.28 cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:14 info: log_data_element: cib_update: + cib[3999]: 2007/09/19_17:13:14 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[3238]: 2007/09/19_17:13:15 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [12:14] heartbeat[3238]: 2007/09/19_17:13:15 info: No pkts missing from host-2.awale.qc.ca! crmd[4003]: 2007/09/19_17:13:15 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[3997]: 2007/09/19_17:13:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:16 info: log_cib_diff: cib_update: Local-only Change: 0.15.28 cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:16 info: log_data_element: cib_update: + heartbeat[3238]: 2007/09/19_17:13:16 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [16:18] heartbeat[3238]: 2007/09/19_17:13:16 info: No pkts missing from host-2.awale.qc.ca! cib[3999]: 2007/09/19_17:13:17 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[4003]: 2007/09/19_17:13:17 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[3999]: 2007/09/19_17:13:17 info: mem_handle_event: no mbr_track info crmd[4003]: 2007/09/19_17:13:17 info: mem_handle_event: no mbr_track info cib[3999]: 2007/09/19_17:13:17 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[4003]: 2007/09/19_17:13:17 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[3999]: 2007/09/19_17:13:17 info: mem_handle_event: instance=4, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[4003]: 2007/09/19_17:13:17 info: mem_handle_event: instance=4, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[3999]: 2007/09/19_17:13:17 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[4003]: 2007/09/19_17:13:17 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=4) cib[3999]: 2007/09/19_17:13:17 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:13:17 info: ccm_event_detail: NEW MEMBERSHIP: trans=4, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[4003]: 2007/09/19_17:13:17 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[4003]: 2007/09/19_17:13:17 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=4] crmd[4003]: 2007/09/19_17:13:17 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=4] cibmon[3997]: 2007/09/19_17:13:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:17 info: log_cib_diff: cib_update: Local-only Change: 0.15.28 cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:17 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:13:20 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[4003]: 2007/09/19_17:13:20 info: update_dc: Set DC to () tengine[4069]: 2007/09/19_17:13:20 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[4003]: 2007/09/19_17:13:20 info: join_make_offer: Making join offers based on membership 4 crmd[4003]: 2007/09/19_17:13:20 info: do_dc_join_offer_all: join-3: Waiting on 2 outstanding join acks crmd[4003]: 2007/09/19_17:13:20 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_17:13:21 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[4003]: 2007/09/19_17:13:21 info: do_state_transition: All 2 cluster nodes responded to the join offer. cib[3999]: 2007/09/19_17:13:21 info: sync_our_cib: Syncing CIB to all peers attrd[4002]: 2007/09/19_17:13:21 info: attrd_local_callback: Sending full refresh cibmon[3997]: 2007/09/19_17:13:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: --- 0.15.28 cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: +++ 0.15.29 cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: --- 0.15.29 cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: +++ 0.15.30 cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: --- 0.15.30 cibmon[3997]: 2007/09/19_17:13:21 info: log_cib_diff: cib_update: Diff: +++ 0.15.31 cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:21 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_17:13:21 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;4:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;16:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;6:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;14:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;31:6:a38b4c13-e34c-4084-9370-1d4f139bb940 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;8:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;10:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;32:23:a38b4c13-e34c-4084-9370-1d4f139bb940 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:21 info: build_operation_update: Digest for 0:0;12:1:a38b4c13-e34c-4084-9370-1d4f139bb940 (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[4003]: 2007/09/19_17:13:21 info: log_data_element: build_operation_update: digest:source crmd[4003]: 2007/09/19_17:13:22 info: do_dc_join_ack: join-3: Updating node state to member for host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:13:22 info: do_dc_join_ack: join-3: Updating node state to member for host-1.awale.qc.ca crmd[4003]: 2007/09/19_17:13:22 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[4003]: 2007/09/19_17:13:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[3997]: 2007/09/19_17:13:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:22 info: log_cib_diff: cib_update: Diff: --- 0.15.31 cibmon[3997]: 2007/09/19_17:13:22 info: log_cib_diff: cib_update: Diff: +++ 0.15.32 cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:22 info: log_cib_diff: cib_update: Diff: --- 0.15.32 cibmon[3997]: 2007/09/19_17:13:22 info: log_cib_diff: cib_update: Diff: +++ 0.15.33 cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:22 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:13:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:13:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:13:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:13:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:13:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:13:23 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:13:23 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:13:23 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[4070]: 2007/09/19_17:13:23 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:13:23 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:13:23 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:23 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[4003]: 2007/09/19_17:13:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[4070]: 2007/09/19_17:13:23 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[4070]: 2007/09/19_17:13:23 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_17:13:23 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:23 notice: StartRsc: host-2.awale.qc.ca Start child_DoFencing:1 pengine[4070]: 2007/09/19_17:13:23 notice: RecurringOp: host-2.awale.qc.ca child_DoFencing:1_monitor_50000 pengine[4070]: 2007/09/19_17:13:23 info: process_pe_message: Transition 25: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-55.bz2 tengine[4069]: 2007/09/19_17:13:23 info: unpack_graph: Unpacked transition 25: 19 actions in 19 synapses tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 12: msg_first_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 13: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 14: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 15: share-FS_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 16: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 17: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 18: msg_last_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 19: mysql_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 41: mysql_stop_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 20: child_DoFencing:0_monitor_0 on host-2.awale.qc.ca tengine[4069]: 2007/09/19_17:13:23 info: send_rsc_command: Initiating action 21: child_DoFencing:1_monitor_0 on host-2.awale.qc.ca crmd[4003]: 2007/09/19_17:13:23 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=41:25:a38b4c13-e34c-4084-9370-1d4f139bb940) cibmon[3997]: 2007/09/19_17:13:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed crmd[4003]: 2007/09/19_17:13:23 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=39, rc=-2) Cancelled cibmon[3997]: 2007/09/19_17:13:23 info: log_cib_diff: cib_delete: Diff: --- 0.15.33 cibmon[3997]: 2007/09/19_17:13:23 info: log_cib_diff: cib_delete: Diff: +++ 0.15.34 cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_17:13:23 info: log_data_element: cib_delete: + cibmon[3997]: 2007/09/19_17:13:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_17:13:24 info: match_graph_event: Action share-drbd_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: --- 0.15.34 cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: +++ 0.15.35 cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_17:13:24 info: match_graph_event: Action vmstat-mon_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: --- 0.15.35 cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: +++ 0.15.36 cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: --- 0.15.36 cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: +++ 0.15.37 cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:24 info: match_graph_event: Action msg_first_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: --- 0.15.37 cibmon[3997]: 2007/09/19_17:13:24 info: log_cib_diff: cib_update: Diff: +++ 0.15.38 cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:13:24 info: match_graph_event: Action share-FS_monitor_0 (15) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:24 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: --- 0.15.38 cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: +++ 0.15.39 cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:25 info: match_graph_event: Action mysql_monitor_0 (19) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: --- 0.15.39 cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: +++ 0.15.40 cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: --- 0.15.40 cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: +++ 0.15.41 cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (17) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: --- 0.15.41 tengine[4069]: 2007/09/19_17:13:25 info: match_graph_event: Action msg_last_monitor_0 (18) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:25 info: log_cib_diff: cib_update: Diff: +++ 0.15.42 cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:25 info: log_data_element: cib_update: + mysql[16918][16954]: 2007/09/19_17:13:26 INFO: MySQL stopped crmd[4003]: 2007/09/19_17:13:26 info: process_lrm_event: LRM operation mysql_stop_0 (call=40, rc=0) complete cibmon[3997]: 2007/09/19_17:13:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: --- 0.15.42 cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: +++ 0.15.43 cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:13:26 info: match_graph_event: Action mysql_stop_0 (41) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: --- 0.15.43 tengine[4069]: 2007/09/19_17:13:26 info: match_graph_event: Action child_DoFencing:0_monitor_0 (20) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: +++ 0.15.44 cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: --- 0.15.44 tengine[4069]: 2007/09/19_17:13:26 info: match_graph_event: Action child_DoFencing:1_monitor_0 (21) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_cib_diff: cib_update: Diff: +++ 0.15.45 tengine[4069]: 2007/09/19_17:13:26 info: send_rsc_command: Initiating action 11: probe_complete on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:13:26 info: te_pseudo_action: Pseudo action 10 fired and confirmed cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:26 info: send_rsc_command: Initiating action 42: mysql_start_0 on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:26 info: te_pseudo_action: Pseudo action 48 fired and confirmed cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_17:13:26 info: send_rsc_command: Initiating action 46: child_DoFencing:1_start_0 on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:26 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[4069]: 2007/09/19_17:13:27 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[3997]: 2007/09/19_17:13:27 info: log_cib_diff: cib_modify: Diff: --- 0.15.45 tengine[4069]: 2007/09/19_17:13:27 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_17:13:27 info: log_cib_diff: cib_modify: Diff: +++ 0.15.46 tengine[4069]: 2007/09/19_17:13:27 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: - cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_modify: + cibmon[3997]: 2007/09/19_17:13:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_17:13:27 info: match_graph_event: Action child_DoFencing:1_start_0 (46) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:27 info: log_cib_diff: cib_update: Diff: --- 0.15.46 tengine[4069]: 2007/09/19_17:13:27 info: te_pseudo_action: Pseudo action 49 fired and confirmed cibmon[3997]: 2007/09/19_17:13:27 info: log_cib_diff: cib_update: Diff: +++ 0.15.47 cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:27 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:31 info: log_cib_diff: cib_update: Diff: --- 0.15.47 tengine[4069]: 2007/09/19_17:13:31 info: match_graph_event: Action mysql_start_0 (42) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:31 info: log_cib_diff: cib_update: Diff: +++ 0.15.48 crmd[4003]: 2007/09/19_17:13:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:13:31 info: run_graph: ==================================================== cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: - crmd[4003]: 2007/09/19_17:13:31 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[4069]: 2007/09/19_17:13:31 notice: run_graph: Transition 25: (Complete=17, Pending=0, Fired=0, Skipped=2, Incomplete=0) cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:31 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_17:13:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:13:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:13:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:13:31 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:13:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:13:31 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[4003]: 2007/09/19_17:13:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[4070]: 2007/09/19_17:13:31 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_17:13:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:13:31 info: unpack_graph: Unpacked transition 26: 2 actions in 2 synapses pengine[4070]: 2007/09/19_17:13:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:13:31 info: send_rsc_command: Initiating action 32: mysql_monitor_120000 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:13:31 info: send_rsc_command: Initiating action 37: child_DoFencing:1_monitor_50000 on host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:13:31 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:13:31 notice: RecurringOp: host-2.awale.qc.ca child_DoFencing:1_monitor_50000 pengine[4070]: 2007/09/19_17:13:31 info: process_pe_message: Transition 26: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-56.bz2 cibmon[3997]: 2007/09/19_17:13:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:33 info: log_cib_diff: cib_update: Diff: --- 0.15.48 tengine[4069]: 2007/09/19_17:13:33 info: match_graph_event: Action child_DoFencing:1_monitor_50000 (37) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:33 info: log_cib_diff: cib_update: Diff: +++ 0.15.49 cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_17:13:33 info: log_cib_diff: cib_update: Diff: --- 0.15.49 tengine[4069]: 2007/09/19_17:13:33 info: match_graph_event: Action mysql_monitor_120000 (32) confirmed on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_17:13:33 info: log_cib_diff: cib_update: Diff: +++ 0.15.50 crmd[4003]: 2007/09/19_17:13:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[4069]: 2007/09/19_17:13:33 info: run_graph: Transition 26: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_17:13:33 info: notify_crmd: Transition 26 status: te_complete - cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_17:13:33 info: log_data_element: cib_update: + heartbeat[3238]: 2007/09/19_17:13:38 ERROR: api_process_request: bad request [nodestatus] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG: Dumping message with 6 fields heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[0] : [t=hbapi-req] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[1] : [reqtype=nodestatus] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[2] : [dest=host-1.awale.qc.ca] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[3] : [pid=16985] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[4] : [from_id=16985] heartbeat[3238]: 2007/09/19_17:13:38 ERROR: MSG[5] : [node=host-1] stonithd[17033]: 2007/09/19_17:13:53 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17033]: 2007/09/19_17:13:53 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[17182]: 2007/09/19_17:14:43 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17182]: 2007/09/19_17:14:43 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[17390]: 2007/09/19_17:15:33 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17390]: 2007/09/19_17:15:33 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[17538]: 2007/09/19_17:16:23 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17538]: 2007/09/19_17:16:23 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[17763]: 2007/09/19_17:17:13 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17763]: 2007/09/19_17:17:13 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[17897]: 2007/09/19_17:18:04 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[17897]: 2007/09/19_17:18:04 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_17:18:26 info: cib_stats: Processed 53 operations (9245.00us average, 0% utilization) in the last 10min stonithd[18074]: 2007/09/19_17:18:54 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18074]: 2007/09/19_17:18:54 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[18270]: 2007/09/19_17:19:44 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18270]: 2007/09/19_17:19:44 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[18398]: 2007/09/19_17:20:34 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18398]: 2007/09/19_17:20:34 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[18619]: 2007/09/19_17:21:24 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18619]: 2007/09/19_17:21:24 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[18763]: 2007/09/19_17:22:14 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18763]: 2007/09/19_17:22:14 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[18970]: 2007/09/19_17:23:04 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[18970]: 2007/09/19_17:23:04 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19112]: 2007/09/19_17:23:54 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19112]: 2007/09/19_17:23:54 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19254]: 2007/09/19_17:24:44 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19254]: 2007/09/19_17:24:44 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19463]: 2007/09/19_17:25:34 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19463]: 2007/09/19_17:25:34 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19605]: 2007/09/19_17:26:24 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19605]: 2007/09/19_17:26:25 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19826]: 2007/09/19_17:27:15 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19826]: 2007/09/19_17:27:15 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[19954]: 2007/09/19_17:28:05 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[19954]: 2007/09/19_17:28:05 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[20129]: 2007/09/19_17:28:55 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[20129]: 2007/09/19_17:28:55 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[20319]: 2007/09/19_17:29:45 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[20319]: 2007/09/19_17:29:45 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[20447]: 2007/09/19_17:30:35 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[20447]: 2007/09/19_17:30:35 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[20668]: 2007/09/19_17:31:25 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[20668]: 2007/09/19_17:31:25 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[20812]: 2007/09/19_17:32:15 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[20812]: 2007/09/19_17:32:15 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21019]: 2007/09/19_17:33:05 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21019]: 2007/09/19_17:33:05 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21161]: 2007/09/19_17:33:55 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21161]: 2007/09/19_17:33:55 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21303]: 2007/09/19_17:34:46 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21303]: 2007/09/19_17:34:46 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21512]: 2007/09/19_17:35:36 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21512]: 2007/09/19_17:35:36 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21654]: 2007/09/19_17:36:26 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21654]: 2007/09/19_17:36:26 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[21875]: 2007/09/19_17:37:16 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[21875]: 2007/09/19_17:37:16 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22005]: 2007/09/19_17:38:06 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22005]: 2007/09/19_17:38:06 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22178]: 2007/09/19_17:38:56 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22178]: 2007/09/19_17:38:56 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22368]: 2007/09/19_17:39:46 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22368]: 2007/09/19_17:39:46 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22496]: 2007/09/19_17:40:36 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22496]: 2007/09/19_17:40:36 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22719]: 2007/09/19_17:41:26 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22719]: 2007/09/19_17:41:26 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[22861]: 2007/09/19_17:42:16 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[22861]: 2007/09/19_17:42:16 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23068]: 2007/09/19_17:43:07 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23068]: 2007/09/19_17:43:07 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23216]: 2007/09/19_17:43:57 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23216]: 2007/09/19_17:43:57 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23361]: 2007/09/19_17:44:47 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23361]: 2007/09/19_17:44:47 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23568]: 2007/09/19_17:45:37 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23568]: 2007/09/19_17:45:37 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23710]: 2007/09/19_17:46:27 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23710]: 2007/09/19_17:46:27 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[23931]: 2007/09/19_17:47:17 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[23931]: 2007/09/19_17:47:17 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[24065]: 2007/09/19_17:48:07 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24065]: 2007/09/19_17:48:07 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[24240]: 2007/09/19_17:48:57 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24240]: 2007/09/19_17:48:57 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_17:49:00 ERROR: No declaration for attribute on_fail of element primitive cib[3999]: 2007/09/19_17:49:00 ERROR: validate_with_dtd: CIB does not validate against /usr/share/heartbeat/crm.dtd cib[3999]: 2007/09/19_17:49:00 ERROR: activateCibXml: Ignoring invalid CIB cib[3999]: 2007/09/19_17:49:00 WARN: activateCibXml: Reverting to last known CIB cib[3999]: 2007/09/19_17:49:00 WARN: cib_process_command: Activation failed cib[3999]: 2007/09/19_17:49:00 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[3997]: 2007/09/19_17:49:00 WARN: cibmon_diff: [cib_diff_notify] cib_modify ABORTED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cib[3999]: 2007/09/19_17:49:00 WARN: cib_diff_notify: Update (client: 24270, call:2): 0.15.50 -> 0.16.1 (Update does conform to the DTD in /usr/share/heartbeat/crm.dtd) cibmon[3997]: 2007/09/19_17:49:00 WARN: log_cib_diff: cib_modify: Diff: --- 0.15.50 cibmon[3997]: 2007/09/19_17:49:00 WARN: log_cib_diff: cib_modify: Diff: +++ 0.16.1 cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: - cib[3999]: 2007/09/19_17:49:00 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 ERROR: cib_process_request: cib_modify operation failed: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: crm_log_message_adv: #========= Input message message start ==========# cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: MSG: Dumping message with 8 fields cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: MSG[0] : [__name__=cib_command] cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: MSG[1] : [t=cib] cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: MSG[2] : [cib_op=cib_modify] cibmon[3997]: 2007/09/19_17:49:00 WARN: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:49:00 info: MSG[3] : [cib_callid=2] cibmon[3997]: 2007/09/19_17:49:00 info: log_data_element: raw_update: cib[3999]: 2007/09/19_17:49:00 info: MSG[4] : [cib_callopt=0] cib[3999]: 2007/09/19_17:49:00 info: MSG[5] : [(2)cib_calldata=0x8c25738(68 84)] cib[3999]: 2007/09/19_17:49:00 info: cib[3999]: 2007/09/19_17:49:00 info: MSG[6] : [cib_clientid=dd50787f-0f23-45e9-96b5-580bbc11eeb2] cib[3999]: 2007/09/19_17:49:00 info: MSG[7] : [cib_clientname=24270] stonithd[24432]: 2007/09/19_17:49:47 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24432]: 2007/09/19_17:49:47 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[24561]: 2007/09/19_17:50:37 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24561]: 2007/09/19_17:50:38 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[3997]: 2007/09/19_17:50:45 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[3997]: 2007/09/19_17:50:45 info: log_cib_diff: cib_modify: Diff: --- 0.15.50 cibmon[3997]: 2007/09/19_17:50:45 info: log_cib_diff: cib_modify: Diff: +++ 0.16.1 cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: - cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: - cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + cib[3999]: 2007/09/19_17:50:45 info: log_data_element: cib:diff: + cibmon[3997]: 2007/09/19_17:50:45 info: log_data_element: cib_modify: + tengine[4069]: 2007/09/19_17:50:45 info: update_abort_priority: Abort priority upgraded to 1000000 cib[24594]: 2007/09/19_17:50:45 info: write_cib_contents: Wrote version 0.16.1 of the CIB to disk (digest: b96b0772c03e0faa02c3a145ea3d1439) pengine[4070]: 2007/09/19_17:50:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_17:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_17:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_17:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_17:50:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_17:50:45 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_17:50:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[4070]: 2007/09/19_17:50:45 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[4069]: 2007/09/19_17:50:45 info: unpack_graph: Unpacked transition 27: 0 actions in 0 synapses pengine[4070]: 2007/09/19_17:50:45 info: group_print: Resource Group: group-DW tengine[4069]: 2007/09/19_17:50:45 info: run_graph: Transition 27: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[4070]: 2007/09/19_17:50:45 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[4069]: 2007/09/19_17:50:45 info: notify_crmd: Transition 27 status: te_complete - pengine[4070]: 2007/09/19_17:50:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_17:50:45 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_17:50:45 info: process_pe_message: Transition 27: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-57.bz2 stonithd[24789]: 2007/09/19_17:51:28 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24789]: 2007/09/19_17:51:28 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[24931]: 2007/09/19_17:52:18 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[24931]: 2007/09/19_17:52:18 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25138]: 2007/09/19_17:53:08 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25138]: 2007/09/19_17:53:08 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25282]: 2007/09/19_17:53:58 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25282]: 2007/09/19_17:53:58 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25424]: 2007/09/19_17:54:48 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25424]: 2007/09/19_17:54:48 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25631]: 2007/09/19_17:55:38 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25631]: 2007/09/19_17:55:38 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25773]: 2007/09/19_17:56:28 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25773]: 2007/09/19_17:56:28 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[25996]: 2007/09/19_17:57:18 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[25996]: 2007/09/19_17:57:18 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[26133]: 2007/09/19_17:58:09 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26133]: 2007/09/19_17:58:09 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[3999]: 2007/09/19_17:58:26 info: cib_stats: Processed 3 operations (30000.00us average, 0% utilization) in the last 10min stonithd[26297]: 2007/09/19_17:58:59 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26297]: 2007/09/19_17:58:59 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[26487]: 2007/09/19_17:59:49 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26487]: 2007/09/19_17:59:49 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[26631]: 2007/09/19_18:00:39 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26631]: 2007/09/19_18:00:39 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[26840]: 2007/09/19_18:01:29 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26840]: 2007/09/19_18:01:29 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[26987]: 2007/09/19_18:02:19 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[26987]: 2007/09/19_18:02:19 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[27208]: 2007/09/19_18:03:09 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[27208]: 2007/09/19_18:03:09 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[27338]: 2007/09/19_18:03:59 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[27338]: 2007/09/19_18:03:59 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[27480]: 2007/09/19_18:04:49 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[27480]: 2007/09/19_18:04:49 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[27703]: 2007/09/19_18:05:39 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[27703]: 2007/09/19_18:05:39 info: 10.0.0.166 has sysName 'RackPDU Archivage' heartbeat[3238]: 2007/09/19_18:06:28 info: killing /usr/lib/heartbeat/mgmtd -v process group 4004 with signal 15 mgmtd[4004]: 2007/09/19_18:06:28 info: mgmtd is shutting down heartbeat[3238]: 2007/09/19_18:06:28 info: killing /usr/lib/heartbeat/crmd process group 4003 with signal 15 cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: --- 0.16.1 tengine[4069]: 2007/09/19_18:06:28 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: +++ 0.16.2 tengine[4069]: 2007/09/19_18:06:28 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_18:06:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[4070]: 2007/09/19_18:06:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[4070]: 2007/09/19_18:06:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[4070]: 2007/09/19_18:06:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[4070]: 2007/09/19_18:06:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[4070]: 2007/09/19_18:06:28 notice: unpack_config: On loss of CCM Quorum: Ignore pengine[4070]: 2007/09/19_18:06:28 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[4070]: 2007/09/19_18:06:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[4070]: 2007/09/19_18:06:28 info: group_print: Resource Group: group-DW pengine[4070]: 2007/09/19_18:06:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: clone_print: Clone Set: DoFencing pengine[4070]: 2007/09/19_18:06:28 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource share-drbd (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource share-FS (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource share-drbdlinks (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[4070]: 2007/09/19_18:06:28 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[4070]: 2007/09/19_18:06:28 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 WARN: native_color: Resource child_DoFencing:0 cannot run anywhere pengine[4070]: 2007/09/19_18:06:28 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) pengine[4070]: 2007/09/19_18:06:28 notice: StopRsc: host-1.awale.qc.ca Stop child_DoFencing:0 pengine[4070]: 2007/09/19_18:06:28 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown tengine[4069]: 2007/09/19_18:06:28 info: unpack_graph: Unpacked transition 28: 29 actions in 29 synapses pengine[4070]: 2007/09/19_18:06:28 WARN: process_pe_message: Transition 28: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-170.bz2 tengine[4069]: 2007/09/19_18:06:28 info: te_pseudo_action: Pseudo action 37 fired and confirmed pengine[4070]: 2007/09/19_18:06:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[4069]: 2007/09/19_18:06:28 info: send_rsc_command: Initiating action 32: msg_last_stop_0 on host-1.awale.qc.ca tengine[4069]: 2007/09/19_18:06:28 info: te_pseudo_action: Pseudo action 46 fired and confirmed tengine[4069]: 2007/09/19_18:06:28 info: send_rsc_command: Initiating action 43: child_DoFencing:0_stop_0 on host-1.awale.qc.ca lrmd[27846]: 2007/09/19_18:06:28 info: Try to stop STONITH resource : Device=apcsnmp cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: --- 0.16.2 cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: +++ 0.16.3 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: + cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: --- 0.16.3 cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: +++ 0.16.4 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: + cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_18:06:28 info: match_graph_event: Action child_DoFencing:0_stop_0 (43) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: --- 0.16.4 tengine[4069]: 2007/09/19_18:06:28 info: te_pseudo_action: Pseudo action 47 fired and confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: +++ 0.16.5 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + msg[27845][27868]: 2007/09/19_18:06:28 INFO Starting to switch away from this node. msg[27845][27869]: 2007/09/19_18:06:28 INFO Node: host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: --- 0.16.5 cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_update: Diff: +++ 0.16.6 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_18:06:28 info: match_graph_event: Action msg_last_stop_0 (32) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:28 info: send_rsc_command: Initiating action 29: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:28 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: --- 0.16.6 cibmon[3997]: 2007/09/19_18:06:28 info: log_cib_diff: cib_delete: Diff: +++ 0.16.7 cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:28 info: log_data_element: cib_delete: + lrmd[4000]: 2007/09/19_18:06:28 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[4000]: 2007/09/19_18:06:29 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[27879][27894]: 2007/09/19_18:06:29 INFO: ifconfig eth0:0 down cibmon[3997]: 2007/09/19_18:06:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_update: Diff: --- 0.16.7 cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_update: Diff: +++ 0.16.8 cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_18:06:29 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (29) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:29 info: send_rsc_command: Initiating action 26: share-drbdlinks_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_delete: Diff: --- 0.16.8 cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_delete: Diff: +++ 0.16.9 cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: + tengine[4069]: 2007/09/19_18:06:29 info: match_graph_event: Action share-drbdlinks_stop_0 (26) confirmed on host-1.awale.qc.ca tengine[4069]: 2007/09/19_18:06:29 info: send_rsc_command: Initiating action 23: share-FS_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_update: Diff: --- 0.16.9 cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_update: Diff: +++ 0.16.10 cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:29 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_delete: Diff: --- 0.16.10 cibmon[3997]: 2007/09/19_18:06:29 info: log_cib_diff: cib_delete: Diff: +++ 0.16.11 cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:29 info: log_data_element: cib_delete: + Filesystem[27901][27930]: 2007/09/19_18:06:29 INFO: Running stop for /dev/drbd0 on /share Filesystem[27901][27940]: 2007/09/19_18:06:30 INFO: Trying to unmount /share Filesystem[27901][27942]: 2007/09/19_18:06:30 INFO: unmounted /share successfully cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: --- 0.16.11 tengine[4069]: 2007/09/19_18:06:30 info: match_graph_event: Action share-FS_stop_0 (23) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: +++ 0.16.12 tengine[4069]: 2007/09/19_18:06:30 info: send_rsc_command: Initiating action 20: share-drbd_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: --- 0.16.12 cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: +++ 0.16.13 cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: + tengine[4069]: 2007/09/19_18:06:30 info: match_graph_event: Action share-drbd_stop_0 (20) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_18:06:30 info: send_rsc_command: Initiating action 17: vmstat-mon_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: --- 0.16.13 cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: +++ 0.16.14 cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: --- 0.16.14 cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: +++ 0.16.15 cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: + daemontools[27950][27959]: 2007/09/19_18:06:30 INFO Stoping vmstat-mon cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[4069]: 2007/09/19_18:06:30 info: match_graph_event: Action vmstat-mon_stop_0 (17) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: --- 0.16.15 tengine[4069]: 2007/09/19_18:06:30 info: send_rsc_command: Initiating action 14: msg_first_stop_0 on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_update: Diff: +++ 0.16.16 cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:30 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: --- 0.16.16 cibmon[3997]: 2007/09/19_18:06:30 info: log_cib_diff: cib_delete: Diff: +++ 0.16.17 cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: - cibmon[3997]: 2007/09/19_18:06:30 info: log_data_element: cib_delete: + msg[27962][27983]: 2007/09/19_18:06:30 INFO Completed switching away from this node. msg[27962][27984]: 2007/09/19_18:06:30 INFO Node: host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:31 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:31 info: log_cib_diff: cib_update: Diff: --- 0.16.17 cibmon[3997]: 2007/09/19_18:06:31 info: log_cib_diff: cib_update: Diff: +++ 0.16.18 tengine[4069]: 2007/09/19_18:06:31 info: match_graph_event: Action msg_first_stop_0 (14) confirmed on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: - tengine[4069]: 2007/09/19_18:06:31 info: te_pseudo_action: Pseudo action 38 fired and confirmed cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:31 info: te_crm_command: Executing crm-event (48): do_shutdown on host-1.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:31 info: te_crm_command: Skipping wait for 48 cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_18:06:31 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs tengine[4069]: 2007/09/19_18:06:31 info: te_pseudo_action: Pseudo action 35 fired and confirmed cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + crmd[4003]: 2007/09/19_18:06:31 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) tengine[4069]: 2007/09/19_18:06:31 info: send_rsc_command: Initiating action 15: msg_first_start_0 on host-2.awale.qc.ca cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + pengine[4070]: 2007/09/19_18:06:31 info: pengine_shutdown: Exiting PEngine (SIGTERM) cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:31 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:31 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[4069]: 2007/09/19_18:06:31 info: update_abort_priority: Abort action 0 superceeded by 3 cibmon[3997]: 2007/09/19_18:06:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[3997]: 2007/09/19_18:06:32 info: log_cib_diff: cib_update: Diff: --- 0.16.18 cibmon[3997]: 2007/09/19_18:06:32 info: log_cib_diff: cib_update: Diff: +++ 0.16.19 cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: - cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + cibmon[3997]: 2007/09/19_18:06:32 info: log_data_element: cib_update: + tengine[4069]: 2007/09/19_18:06:32 info: match_graph_event: Action msg_first_start_0 (15) confirmed on host-2.awale.qc.ca tengine[4069]: 2007/09/19_18:06:32 info: run_graph: ==================================================== tengine[4069]: 2007/09/19_18:06:32 notice: run_graph: Transition 28: (Complete=15, Pending=0, Fired=0, Skipped=14, Incomplete=0) tengine[4069]: 2007/09/19_18:06:32 info: notify_crmd: Exiting after transition tengine[4069]: 2007/09/19_18:06:32 info: te_init: Exiting tengine ccm[3998]: 2007/09/19_18:06:32 info: client (pid=4003) removed from ccm cib[3999]: 2007/09/19_18:06:32 info: cib_process_readwrite: We are now in R/O mode cib[3999]: 2007/09/19_18:06:32 WARN: send_via_callback_channel: Cannot find client for token 0fb71c24-1b42-4628-bcfa-c9799961bbb5 cib[3999]: 2007/09/19_18:06:32 WARN: do_local_notify: A-Sync reply to 4003 failed: client left before we could send reply heartbeat[3238]: 2007/09/19_18:06:32 info: killing /usr/lib/heartbeat/attrd process group 4002 with signal 15 attrd[4002]: 2007/09/19_18:06:32 info: attrd_shutdown: Exiting attrd[4002]: 2007/09/19_18:06:32 info: main: Exiting... heartbeat[3238]: 2007/09/19_18:06:32 info: killing /usr/lib/heartbeat/stonithd process group 4001 with signal 15 stonithd[4001]: 2007/09/19_18:06:32 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[3238]: 2007/09/19_18:06:32 info: killing /usr/lib/heartbeat/lrmd -r process group 4000 with signal 15 lrmd[4000]: 2007/09/19_18:06:32 info: lrmd is shutting down heartbeat[3238]: 2007/09/19_18:06:32 info: killing /usr/lib/heartbeat/cib process group 3999 with signal 15 cibmon[3997]: 2007/09/19_18:06:32 ERROR: cib_native_msgready: Message pending on command channel [3999] cib[3999]: 2007/09/19_18:06:32 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[3997]: 2007/09/19_18:06:32 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[3999]: 2007/09/19_18:06:32 WARN: disconnect_cib_client: Disconnecting /cib_ro... cibmon[3997]: 2007/09/19_18:06:32 ERROR: MSG: No message to dump cib[3999]: 2007/09/19_18:06:32 info: cib_shutdown: Disconnected 2 clients cibmon[3997]: 2007/09/19_18:06:32 info: cib_native_msgready: Lost connection to the CIB service [3999]. cib[3999]: 2007/09/19_18:06:32 info: cib_process_disconnect: All clients disconnected... cibmon[3997]: 2007/09/19_18:06:32 CRIT: cib_native_dispatch: Lost connection to the CIB service [3999/callback]. cib[3999]: 2007/09/19_18:06:32 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[3997]: 2007/09/19_18:06:32 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[3999]: 2007/09/19_18:06:33 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[3999]: 2007/09/19_18:06:33 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[3999]: 2007/09/19_18:06:33 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[3999]: 2007/09/19_18:06:33 info: main: Done ccm[3998]: 2007/09/19_18:06:33 info: client (pid=3999) removed from ccm heartbeat[3238]: 2007/09/19_18:06:33 info: killing /usr/lib/heartbeat/ccm process group 3998 with signal 15 ccm[3998]: 2007/09/19_18:06:33 info: received SIGTERM, going to shut down heartbeat[3238]: 2007/09/19_18:06:33 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[3238]: 2007/09/19_18:06:34 info: killing HBWRITE process 3246 with signal 15 heartbeat[3238]: 2007/09/19_18:06:34 info: killing HBREAD process 3247 with signal 15 heartbeat[3238]: 2007/09/19_18:06:34 info: killing HBWRITE process 3248 with signal 15 heartbeat[3238]: 2007/09/19_18:06:34 info: killing HBREAD process 3250 with signal 15 heartbeat[3238]: 2007/09/19_18:06:34 info: killing HBFIFO process 3244 with signal 15 heartbeat[3238]: 2007/09/19_18:06:34 info: Core process 3244 exited. 5 remaining heartbeat[3238]: 2007/09/19_18:06:34 info: Core process 3248 exited. 4 remaining heartbeat[3238]: 2007/09/19_18:06:34 info: Core process 3246 exited. 3 remaining heartbeat[3238]: 2007/09/19_18:06:34 info: Core process 3250 exited. 2 remaining heartbeat[3238]: 2007/09/19_18:06:34 info: Core process 3247 exited. 1 remaining heartbeat[3238]: 2007/09/19_18:06:34 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[3221]: 2007/09/19_18:06:35 info: logd_term_write_action: received SIGTERM logd[3221]: 2007/09/19_18:06:35 info: Exiting write process logd[28029]: 2007/09/19_18:06:54 info: logd started with /etc/logd.cf. logd[28033]: 2007/09/19_18:06:54 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[28029]: 2007/09/19_18:06:54 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[28050]: 2007/09/19_18:06:54 info: No log entry found in ha.cf -- use logd heartbeat[28050]: 2007/09/19_18:06:54 info: Enabling logging daemon heartbeat[28050]: 2007/09/19_18:06:54 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[28050]: 2007/09/19_18:06:54 info: ************************** heartbeat[28050]: 2007/09/19_18:06:54 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[28051]: 2007/09/19_18:06:54 info: heartbeat: version 2.1.2 heartbeat[28051]: 2007/09/19_18:06:54 info: Heartbeat generation: 1188360848 heartbeat[28051]: 2007/09/19_18:06:54 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[28051]: 2007/09/19_18:06:54 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[28051]: 2007/09/19_18:06:54 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[28051]: 2007/09/19_18:06:54 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[28051]: 2007/09/19_18:06:54 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[28051]: 2007/09/19_18:06:54 info: glib: ping group heartbeat started. heartbeat[28051]: 2007/09/19_18:06:54 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[28051]: 2007/09/19_18:06:54 info: Local status now set to: 'up' heartbeat[28051]: 2007/09/19_18:06:55 info: Link local:local up. heartbeat[28051]: 2007/09/19_18:06:55 info: Status update for node local: status ping heartbeat[28051]: 2007/09/19_18:06:55 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[28051]: 2007/09/19_18:06:55 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[28051]: 2007/09/19_18:06:56 info: Status update for node host-2.awale.qc.ca: status active heartbeat[28051]: 2007/09/19_18:06:56 info: Comm_now_up(): updating status to active heartbeat[28051]: 2007/09/19_18:06:56 info: Local status now set to: 'active' heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[28062]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 28062) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[28051]: 2007/09/19_18:06:56 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[28051]: 2007/09/19_18:06:56 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 100 ms (> 50 ms) (GSource: 0x943d228) heartbeat[28063]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 28063) heartbeat[28064]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 28064) heartbeat[28065]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 28065) cibmon[28062]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[28067]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 28067) heartbeat[28066]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 28066) heartbeat[28068]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 28068) heartbeat[28069]: 2007/09/19_18:06:56 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 28069) cib[28064]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[28064]: 2007/09/19_18:06:56 info: G_main_add_TriggerHandler: Added signal manual handler cib[28064]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[28064]: 2007/09/19_18:06:56 info: main: Retrieval of a per-action CIB: disabled cib[28064]: 2007/09/19_18:06:56 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] lrmd[28065]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] ccm[28063]: 2007/09/19_18:06:56 info: Hostname: host-1.awale.qc.ca cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: log_data_element: readCibXmlFile: [on-disk] cib[28064]: 2007/09/19_18:06:56 info: startCib: CIB Initialization completed successfully cib[28064]: 2007/09/19_18:06:56 info: cib_register_ha: Signing in with Heartbeat cib[28064]: 2007/09/19_18:06:56 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[28064]: 2007/09/19_18:06:56 WARN: cib_init: CCM Activation failed cib[28064]: 2007/09/19_18:06:56 WARN: cib_init: CCM Connection failed 1 times (30 max) lrmd[28065]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[28065]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[28065]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[28065]: 2007/09/19_18:06:56 info: Started. mgmtd[28069]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[28069]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[28069]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 12 crmd[28068]: 2007/09/19_18:06:56 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[28068]: 2007/09/19_18:06:56 info: crmd_init: Starting crmd crmd[28068]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[28068]: 2007/09/19_18:06:56 info: G_main_add_TriggerHandler: Added signal manual handler crmd[28068]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 17 stonithd[28066]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[28066]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[28067]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[28067]: 2007/09/19_18:06:56 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[28067]: 2007/09/19_18:06:56 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 stonithd[28066]: 2007/09/19_18:06:56 info: Signing in with heartbeat. mgmtd[28069]: 2007/09/19_18:06:56 info: init_crm stonithd[28066]: 2007/09/19_18:06:56 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[28066]: 2007/09/19_18:06:56 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[28064]: 2007/09/19_18:06:57 WARN: cib_init: CCM Activation failed cib[28064]: 2007/09/19_18:06:57 WARN: cib_init: CCM Connection failed 2 times (30 max) ccm[28063]: 2007/09/19_18:06:58 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[28064]: 2007/09/19_18:06:58 info: cib_init: Starting cib mainloop cib[28064]: 2007/09/19_18:06:58 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[28064]: 2007/09/19_18:06:58 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] crmd[28068]: 2007/09/19_18:06:58 info: do_cib_control: CIB connection established cib[28064]: 2007/09/19_18:06:58 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[28064]: 2007/09/19_18:06:58 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cibmon[28062]: 2007/09/19_18:06:58 info: main: Starting mainloop crmd[28068]: 2007/09/19_18:06:58 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[28064]: 2007/09/19_18:06:58 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[28070]: 2007/09/19_18:06:59 info: write_cib_contents: Wrote version 0.16.1 of the CIB to disk (digest: b49800424d874be9008bdf5709cbb8bf) cib[28064]: 2007/09/19_18:06:59 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[28068]: 2007/09/19_18:06:59 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 crmd[28068]: 2007/09/19_18:06:59 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[28069]: 2007/09/19_18:07:00 info: Started. crmd[28068]: 2007/09/19_18:07:00 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[28068]: 2007/09/19_18:07:00 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[28068]: 2007/09/19_18:07:00 info: do_ha_control: Connected to Heartbeat crmd[28068]: 2007/09/19_18:07:00 info: do_ccm_control: CCM connection established... waiting for first callback crmd[28068]: 2007/09/19_18:07:00 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[28068]: 2007/09/19_18:07:00 info: crmd_init: Starting crmd's mainloop crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[28068]: 2007/09/19_18:07:00 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[28068]: 2007/09/19_18:07:00 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[28068]: 2007/09/19_18:07:01 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[28062]: 2007/09/19_18:07:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[28062]: 2007/09/19_18:07:01 info: log_cib_diff: cib_update: Local-only Change: 0.16.1 cibmon[28062]: 2007/09/19_18:07:01 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:01 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:01 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:01 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:01 info: log_data_element: cib_update: + crmd[28068]: 2007/09/19_18:07:01 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cib[28064]: 2007/09/19_18:07:02 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[28064]: 2007/09/19_18:07:02 info: mem_handle_event: instance=6, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[28068]: 2007/09/19_18:07:02 info: do_started: Delaying start, CCM (0000000000100000) not connected cib[28064]: 2007/09/19_18:07:02 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[28068]: 2007/09/19_18:07:02 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[28064]: 2007/09/19_18:07:02 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:07:02 info: mem_handle_event: instance=6, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[28068]: 2007/09/19_18:07:02 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=6) crmd[28068]: 2007/09/19_18:07:02 info: ccm_event_detail: NEW MEMBERSHIP: trans=6, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 crmd[28068]: 2007/09/19_18:07:02 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=4] crmd[28068]: 2007/09/19_18:07:02 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=6] crmd[28068]: 2007/09/19_18:07:02 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=4] crmd[28068]: 2007/09/19_18:07:02 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=6] crmd[28068]: 2007/09/19_18:07:02 info: do_started: The local CRM is operational crmd[28068]: 2007/09/19_18:07:02 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[28068]: 2007/09/19_18:07:02 info: update_dc: Set DC to () cibmon[28062]: 2007/09/19_18:07:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[28062]: 2007/09/19_18:07:02 info: log_cib_diff: cib_update: Local-only Change: 0.16.1 cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[28062]: 2007/09/19_18:07:02 info: log_cib_diff: cib_update: Local-only Change: 0.16.1 cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + cibmon[28062]: 2007/09/19_18:07:02 info: log_data_element: cib_update: + attrd[28067]: 2007/09/19_18:07:03 info: main: Starting mainloop... crmd[28068]: 2007/09/19_18:07:04 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[28068]: 2007/09/19_18:07:05 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[28068]: 2007/09/19_18:07:05 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[28064]: 2007/09/19_18:07:05 info: cib_replace_notify: Replaced: 0.16.1 -> 0.16.37 from crmd[28068]: 2007/09/19_18:07:05 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[28062]: 2007/09/19_18:07:05 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_replace: Diff: --- 0.16.1 cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_replace: Diff: +++ 0.16.37 cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: - cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_replace: + cibmon[28062]: 2007/09/19_18:07:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.37 cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.38 cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.38 cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.39 cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.39 cibmon[28062]: 2007/09/19_18:07:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.40 cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:05 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:06 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.40 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.41 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.41 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.42 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.42 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.43 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.43 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.44 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.44 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.45 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.45 cibmon[28062]: 2007/09/19_18:07:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.46 cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:06 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:06 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[28068]: 2007/09/19_18:07:06 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=13:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=14:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:06 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=15:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=16:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=17:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=18:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=19:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=20:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=child_DoFencing:1_monitor_0 key=22:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_0 key=21:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:07 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=7) complete crmd[28068]: 2007/09/19_18:07:07 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.46 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.47 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.47 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.48 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.48 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.49 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.49 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.50 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.50 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.51 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.51 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.52 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.52 cibmon[28062]: 2007/09/19_18:07:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.53 cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:07 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:07 info: process_lrm_event: LRM operation mysql_monitor_0 (call=9, rc=7) complete crmd[28068]: 2007/09/19_18:07:07 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=7) complete crmd[28068]: 2007/09/19_18:07:07 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[28068]: 2007/09/19_18:07:08 info: process_lrm_event: LRM operation child_DoFencing:1_monitor_0 (call=10, rc=7) complete crmd[28068]: 2007/09/19_18:07:08 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=7) complete cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.53 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.54 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.54 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.55 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.55 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.56 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.56 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.57 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:08 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=8, rc=7) complete cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.57 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.58 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:08 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.58 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.59 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.59 cibmon[28062]: 2007/09/19_18:07:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.60 cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:08 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.60 cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.61 cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.61 cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.62 cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + stonithd[28066]: 2007/09/19_18:07:09 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x8936cf0) stonithd[28066]: 2007/09/19_18:07:09 info: G_SIG_dispatch: started at 430073313 should have started at 430073213 crmd[28068]: 2007/09/19_18:07:09 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_0 (call=11, rc=7) complete cibmon[28062]: 2007/09/19_18:07:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.62 cibmon[28062]: 2007/09/19_18:07:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.63 cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:09 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.63 cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.64 cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.64 cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.65 cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.65 cibmon[28062]: 2007/09/19_18:07:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.66 cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:10 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:10 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=24:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:10 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=52:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) lrmd[28182]: 2007/09/19_18:07:10 info: Try to start STONITH resource : Device=apcsnmp stonithd[28192]: 2007/09/19_18:07:11 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[28192]: 2007/09/19_18:07:11 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[28068]: 2007/09/19_18:07:11 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=13, rc=0) complete crmd[28068]: 2007/09/19_18:07:11 info: build_operation_update: Digest for 0:0;52:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[28068]: 2007/09/19_18:07:11 info: log_data_element: build_operation_update: digest:source lrmd[28065]: 2007/09/19_18:07:11 WARN: stonithRA plugin: cannot get shortdesc segment of apcsnmp's metadata. stonithd[28066]: 2007/09/19_18:07:11 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[28066]: 2007/09/19_18:07:11 info: 10.0.0.166 has sysName 'RackPDU Archivage' msg[28181][28204]: 2007/09/19_18:07:11 INFO Starting to switch to this node. msg[28181][28205]: 2007/09/19_18:07:11 INFO Node: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:07:11 info: process_lrm_event: LRM operation msg_first_start_0 (call=12, rc=0) complete crmd[28068]: 2007/09/19_18:07:11 info: build_operation_update: Digest for 0:0;24:1:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[28068]: 2007/09/19_18:07:11 info: log_data_element: build_operation_update: digest:source stonithd[28066]: 2007/09/19_18:07:11 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 360 ms (> 30 ms) (GSource: 0x8936cf0) crmd[28068]: 2007/09/19_18:07:12 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=7:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:12 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_50000 key=29:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.66 cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.67 cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.67 cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.68 cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + stonithd[28217]: 2007/09/19_18:07:12 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cibmon[28062]: 2007/09/19_18:07:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.68 cibmon[28062]: 2007/09/19_18:07:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.69 cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:12 info: log_data_element: cib_apply_diff: + stonithd[28217]: 2007/09/19_18:07:12 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[28068]: 2007/09/19_18:07:12 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=15, rc=0) complete msg[28215][28238]: 2007/09/19_18:07:12 INFO Starting to switch to this node. msg[28215][28239]: 2007/09/19_18:07:12 INFO Node: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:07:12 info: process_lrm_event: LRM operation msg_first_start_0 (call=14, rc=0) complete crmd[28068]: 2007/09/19_18:07:12 info: build_operation_update: Digest for 0:0;7:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[28068]: 2007/09/19_18:07:12 info: log_data_element: build_operation_update: digest:source crmd[28068]: 2007/09/19_18:07:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=8:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:14 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=9:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.69 cibmon[28062]: 2007/09/19_18:07:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.70 cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.70 cibmon[28062]: 2007/09/19_18:07:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.71 cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:14 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:14 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=16, rc=0) complete daemontools[28250][28274]: 2007/09/19_18:07:14 INFO Starting vmstat-mon crmd[28068]: 2007/09/19_18:07:14 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=17, rc=0) complete crmd[28068]: 2007/09/19_18:07:14 info: build_operation_update: Digest for 0:0;9:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[28068]: 2007/09/19_18:07:14 info: log_data_element: build_operation_update: digest:source crmd[28068]: 2007/09/19_18:07:15 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=10:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:15 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=11:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.71 cibmon[28062]: 2007/09/19_18:07:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.72 cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:15 info: process_lrm_event: LRM operation share-drbd_start_0 (call=19, rc=0) complete crmd[28068]: 2007/09/19_18:07:15 info: build_operation_update: Digest for 0:0;11:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[28068]: 2007/09/19_18:07:15 info: log_data_element: build_operation_update: digest:source cibmon[28062]: 2007/09/19_18:07:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.72 cibmon[28062]: 2007/09/19_18:07:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.73 cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:15 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:15 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=18, rc=0) complete crmd[28068]: 2007/09/19_18:07:16 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=12:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:16 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=13:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.73 cibmon[28062]: 2007/09/19_18:07:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.74 cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.74 cibmon[28062]: 2007/09/19_18:07:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.75 cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:16 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:16 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=20, rc=0) complete Filesystem[28296][28328]: 2007/09/19_18:07:17 INFO: Running start for /dev/drbd0 on /share crmd[28068]: 2007/09/19_18:07:17 info: process_lrm_event: LRM operation share-FS_start_0 (call=21, rc=0) complete crmd[28068]: 2007/09/19_18:07:17 info: build_operation_update: Digest for 0:0;13:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[28068]: 2007/09/19_18:07:17 info: log_data_element: build_operation_update: digest:source crmd[28068]: 2007/09/19_18:07:18 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=14:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:18 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=15:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.75 cibmon[28062]: 2007/09/19_18:07:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.76 cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.76 cibmon[28062]: 2007/09/19_18:07:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.77 cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:18 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:18 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=23, rc=0) complete crmd[28068]: 2007/09/19_18:07:18 info: build_operation_update: Digest for 0:0;15:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[28068]: 2007/09/19_18:07:18 info: log_data_element: build_operation_update: digest:source crmd[28068]: 2007/09/19_18:07:18 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=22, rc=0) complete crmd[28068]: 2007/09/19_18:07:20 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=16:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:20 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=17:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.77 cibmon[28062]: 2007/09/19_18:07:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.78 cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.78 cibmon[28062]: 2007/09/19_18:07:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.79 cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:20 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:20 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=24, rc=0) complete IPaddr[28386][28418]: 2007/09/19_18:07:20 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[28386][28423]: 2007/09/19_18:07:20 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[28386][28445]: 2007/09/19_18:07:20 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[28068]: 2007/09/19_18:07:20 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=25, rc=0) complete crmd[28068]: 2007/09/19_18:07:20 info: build_operation_update: Digest for 0:0;17:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[28068]: 2007/09/19_18:07:20 info: log_data_element: build_operation_update: digest:source cibmon[28062]: 2007/09/19_18:07:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.79 cibmon[28062]: 2007/09/19_18:07:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.80 cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:21 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:22 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=18:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:07:22 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=19:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.80 cibmon[28062]: 2007/09/19_18:07:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.81 cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:22 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:22 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=26, rc=0) complete msg[28476][28510]: 2007/09/19_18:07:22 INFO Completed switching to this node. msg[28476][28511]: 2007/09/19_18:07:22 INFO Node: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:07:22 info: process_lrm_event: LRM operation msg_last_start_0 (call=27, rc=0) complete crmd[28068]: 2007/09/19_18:07:22 info: build_operation_update: Digest for 0:0;19:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[28068]: 2007/09/19_18:07:22 info: log_data_element: build_operation_update: digest:source crmd[28068]: 2007/09/19_18:07:24 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=20:2:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[28062]: 2007/09/19_18:07:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.81 cibmon[28062]: 2007/09/19_18:07:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.82 cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.82 cibmon[28062]: 2007/09/19_18:07:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.83 cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:24 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:07:24 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=28, rc=0) complete cibmon[28062]: 2007/09/19_18:07:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:07:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.83 cibmon[28062]: 2007/09/19_18:07:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.84 cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:07:26 info: log_data_element: cib_apply_diff: + stonithd[28066]: 2007/09/19_18:07:56 WARN: Performed 1 more non-realtime malloc calls. stonithd[28066]: 2007/09/19_18:07:56 info: Total non-realtime malloc bytes: 135168 stonithd[28639]: 2007/09/19_18:08:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[28639]: 2007/09/19_18:08:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[28062]: 2007/09/19_18:08:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:08:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.84 cibmon[28062]: 2007/09/19_18:08:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.85 cibmon[28062]: 2007/09/19_18:08:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:08:16 info: log_data_element: cib_apply_diff: + stonithd[28788]: 2007/09/19_18:08:52 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[28788]: 2007/09/19_18:08:52 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[28062]: 2007/09/19_18:08:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:08:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.85 cibmon[28062]: 2007/09/19_18:08:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.86 cibmon[28062]: 2007/09/19_18:08:53 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:08:53 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:08:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:08:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.86 cibmon[28062]: 2007/09/19_18:08:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.16.87 cibmon[28062]: 2007/09/19_18:08:59 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:08:59 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:09:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.16.87 cibmon[28062]: 2007/09/19_18:09:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.1 cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:09 info: log_data_element: cib_apply_diff: + cib[28839]: 2007/09/19_18:09:09 info: write_cib_contents: Wrote version 0.17.1 of the CIB to disk (digest: 27181a726ed36183fd16e4d3dd86375a) cibmon[28062]: 2007/09/19_18:09:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:09:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.1 cibmon[28062]: 2007/09/19_18:09:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.2 cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:10 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:09:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.2 cibmon[28062]: 2007/09/19_18:09:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.3 cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:09:14 info: log_data_element: cib_apply_diff: + stonithd[29025]: 2007/09/19_18:09:42 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[29025]: 2007/09/19_18:09:42 info: 10.0.0.166 has sysName 'RackPDU Archivage' heartbeat[28051]: 2007/09/19_18:10:12 info: killing /usr/lib/heartbeat/mgmtd -v process group 28069 with signal 15 mgmtd[28069]: 2007/09/19_18:10:12 info: mgmtd is shutting down heartbeat[28051]: 2007/09/19_18:10:12 info: killing /usr/lib/heartbeat/crmd process group 28068 with signal 15 crmd[28068]: 2007/09/19_18:10:12 info: crm_shutdown: Requesting shutdown crmd[28068]: 2007/09/19_18:10:12 info: do_shutdown_req: Sending shutdown request to DC: host-2.awale.qc.ca crmd[28068]: 2007/09/19_18:10:12 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=31:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:12 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_stop_0 key=40:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:12 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=28, rc=-2) Cancelled crmd[28068]: 2007/09/19_18:10:12 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=15, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.3 cibmon[28062]: 2007/09/19_18:10:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.4 cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:12 info: log_data_element: cib_apply_diff: + lrmd[29115]: 2007/09/19_18:10:13 info: Try to stop STONITH resource : Device=apcsnmp crmd[28068]: 2007/09/19_18:10:13 info: process_lrm_event: LRM operation child_DoFencing:0_stop_0 (call=30, rc=0) complete msg[29114][29137]: 2007/09/19_18:10:13 INFO Starting to switch away from this node. msg[29114][29138]: 2007/09/19_18:10:13 INFO Node: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:10:13 info: process_lrm_event: LRM operation msg_last_stop_0 (call=29, rc=0) complete cibmon[28062]: 2007/09/19_18:10:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.4 cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.5 cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.5 cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.6 cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.6 cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.7 cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=28:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=26, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:14 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.7 cibmon[28062]: 2007/09/19_18:10:14 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.8 cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:14 info: log_data_element: cib_apply_diff: + lrmd[28065]: 2007/09/19_18:10:14 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[28065]: 2007/09/19_18:10:14 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[29162][29177]: 2007/09/19_18:10:14 INFO: ifconfig eth0:0 down crmd[28068]: 2007/09/19_18:10:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=31, rc=0) complete crmd[28068]: 2007/09/19_18:10:16 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=25:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:16 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=24, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.8 cibmon[28062]: 2007/09/19_18:10:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.9 cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.9 cibmon[28062]: 2007/09/19_18:10:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.10 cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:16 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:16 info: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=32, rc=0) complete crmd[28068]: 2007/09/19_18:10:17 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=22:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:17 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=22, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.10 cibmon[28062]: 2007/09/19_18:10:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.11 cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.11 cibmon[28062]: 2007/09/19_18:10:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.12 cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:17 info: log_data_element: cib_apply_diff: + Filesystem[29184][29213]: 2007/09/19_18:10:17 INFO: Running stop for /dev/drbd0 on /share Filesystem[29184][29223]: 2007/09/19_18:10:17 INFO: Trying to unmount /share Filesystem[29184][29225]: 2007/09/19_18:10:17 INFO: unmounted /share successfully crmd[28068]: 2007/09/19_18:10:17 info: process_lrm_event: LRM operation share-FS_stop_0 (call=33, rc=0) complete cibmon[28062]: 2007/09/19_18:10:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.12 cibmon[28062]: 2007/09/19_18:10:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.13 cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:18 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:19 info: do_lrm_rsc_op: Performing op=share-drbd_stop_0 key=19:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:19 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=20, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.13 cibmon[28062]: 2007/09/19_18:10:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.14 cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:19 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:19 info: process_lrm_event: LRM operation share-drbd_stop_0 (call=34, rc=0) complete crmd[28068]: 2007/09/19_18:10:20 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=16:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:20 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=18, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.14 cibmon[28062]: 2007/09/19_18:10:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.15 cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.15 cibmon[28062]: 2007/09/19_18:10:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.16 cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:20 info: log_data_element: cib_apply_diff: + daemontools[29233][29242]: 2007/09/19_18:10:20 INFO Stoping vmstat-mon crmd[28068]: 2007/09/19_18:10:20 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=35, rc=0) complete cibmon[28062]: 2007/09/19_18:10:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.16 cibmon[28062]: 2007/09/19_18:10:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.17 cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:21 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:22 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=13:4:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[28068]: 2007/09/19_18:10:22 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=16, rc=-2) Cancelled cibmon[28062]: 2007/09/19_18:10:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.17 cibmon[28062]: 2007/09/19_18:10:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.18 cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:22 info: log_data_element: cib_apply_diff: + msg[29245][29266]: 2007/09/19_18:10:22 INFO Completed switching away from this node. msg[29245][29267]: 2007/09/19_18:10:22 INFO Node: host-1.awale.qc.ca crmd[28068]: 2007/09/19_18:10:22 info: process_lrm_event: LRM operation msg_first_stop_0 (call=36, rc=0) complete crmd[28068]: 2007/09/19_18:10:23 info: do_state_transition: State transition S_NOT_DC -> S_STOPPING [ input=I_STOP cause=C_HA_MESSAGE origin=route_message ] crmd[28068]: 2007/09/19_18:10:23 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[28068]: 2007/09/19_18:10:23 info: verify_stopped: Checking for active resources before exit ccm[28063]: 2007/09/19_18:10:23 info: client (pid=28068) removed from ccm crmd[28068]: 2007/09/19_18:10:23 info: verify_stopped: Checking for active resources before exit cibmon[28062]: 2007/09/19_18:10:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.18 cibmon[28062]: 2007/09/19_18:10:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.19 cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[28062]: 2007/09/19_18:10:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.19 cibmon[28062]: 2007/09/19_18:10:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.20 cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: - cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:23 info: do_lrm_control: Disconnected from the LRM cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:23 info: do_ha_control: Disconnected from Heartbeat cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:23 info: do_cib_control: Disconnecting CIB cibmon[28062]: 2007/09/19_18:10:23 info: log_data_element: cib_apply_diff: + crmd[28068]: 2007/09/19_18:10:23 info: crmd_cib_connection_destroy: Connection to the CIB terminated... cib[28064]: 2007/09/19_18:10:23 WARN: send_via_callback_channel: Cannot find client for token 874dcd79-80ba-4828-a76d-e1237741faaa crmd[28068]: 2007/09/19_18:10:23 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd cib[28064]: 2007/09/19_18:10:23 WARN: do_local_notify: A-Sync reply to 28068 failed: client left before we could send reply crmd[28068]: 2007/09/19_18:10:23 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[28068]: 2007/09/19_18:10:23 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[28068]: 2007/09/19_18:10:23 info: do_exit: [crmd] stopped (0) heartbeat[28051]: 2007/09/19_18:10:23 info: killing /usr/lib/heartbeat/attrd process group 28067 with signal 15 heartbeat[28051]: 2007/09/19_18:10:23 info: killing /usr/lib/heartbeat/stonithd process group 28066 with signal 15 attrd[28067]: 2007/09/19_18:10:23 info: attrd_shutdown: Exiting stonithd[28066]: 2007/09/19_18:10:23 notice: /usr/lib/heartbeat/stonithd normally quit. attrd[28067]: 2007/09/19_18:10:23 info: main: Exiting... heartbeat[28051]: 2007/09/19_18:10:23 info: killing /usr/lib/heartbeat/lrmd -r process group 28065 with signal 15 lrmd[28065]: 2007/09/19_18:10:23 info: lrmd is shutting down heartbeat[28051]: 2007/09/19_18:10:23 info: killing /usr/lib/heartbeat/cib process group 28064 with signal 15 cib[28064]: 2007/09/19_18:10:23 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[28064]: 2007/09/19_18:10:23 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cib[28064]: 2007/09/19_18:10:23 info: cib_shutdown: Disconnected 2 clients cibmon[28062]: 2007/09/19_18:10:23 ERROR: cib_native_msgready: Message pending on command channel [28064] cib[28064]: 2007/09/19_18:10:23 info: cib_process_disconnect: All clients disconnected... cibmon[28062]: 2007/09/19_18:10:23 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[28064]: 2007/09/19_18:10:23 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[28062]: 2007/09/19_18:10:23 ERROR: MSG: No message to dump cibmon[28062]: 2007/09/19_18:10:23 info: cib_native_msgready: Lost connection to the CIB service [28064]. cibmon[28062]: 2007/09/19_18:10:23 CRIT: cib_native_dispatch: Lost connection to the CIB service [28064/callback]. cibmon[28062]: 2007/09/19_18:10:23 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[28064]: 2007/09/19_18:10:24 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[28064]: 2007/09/19_18:10:24 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[28064]: 2007/09/19_18:10:24 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[28064]: 2007/09/19_18:10:24 info: main: Done heartbeat[28051]: 2007/09/19_18:10:24 info: killing /usr/lib/heartbeat/ccm process group 28063 with signal 15 ccm[28063]: 2007/09/19_18:10:24 info: received SIGTERM, going to shut down heartbeat[28051]: 2007/09/19_18:10:24 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[28051]: 2007/09/19_18:10:25 info: killing HBFIFO process 28055 with signal 15 heartbeat[28051]: 2007/09/19_18:10:25 info: killing HBWRITE process 28056 with signal 15 heartbeat[28051]: 2007/09/19_18:10:25 info: killing HBREAD process 28057 with signal 15 heartbeat[28051]: 2007/09/19_18:10:25 info: killing HBWRITE process 28058 with signal 15 heartbeat[28051]: 2007/09/19_18:10:25 info: killing HBREAD process 28059 with signal 15 heartbeat[28051]: 2007/09/19_18:10:25 info: Core process 28056 exited. 5 remaining heartbeat[28051]: 2007/09/19_18:10:25 info: Core process 28057 exited. 4 remaining heartbeat[28051]: 2007/09/19_18:10:25 info: Core process 28058 exited. 3 remaining heartbeat[28051]: 2007/09/19_18:10:25 info: Core process 28059 exited. 2 remaining heartbeat[28051]: 2007/09/19_18:10:25 info: Core process 28055 exited. 1 remaining heartbeat[28051]: 2007/09/19_18:10:25 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[28033]: 2007/09/19_18:10:26 info: logd_term_write_action: received SIGTERM logd[28033]: 2007/09/19_18:10:26 info: Exiting write process logd[29323]: 2007/09/19_18:23:16 info: logd started with /etc/logd.cf. logd[29326]: 2007/09/19_18:23:16 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[29323]: 2007/09/19_18:23:16 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[29344]: 2007/09/19_18:23:16 info: No log entry found in ha.cf -- use logd heartbeat[29344]: 2007/09/19_18:23:16 info: Enabling logging daemon heartbeat[29344]: 2007/09/19_18:23:16 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[29344]: 2007/09/19_18:23:16 info: ************************** heartbeat[29344]: 2007/09/19_18:23:16 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[29345]: 2007/09/19_18:23:16 info: heartbeat: version 2.1.2 heartbeat[29345]: 2007/09/19_18:23:16 info: Heartbeat generation: 1188360849 heartbeat[29345]: 2007/09/19_18:23:16 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[29345]: 2007/09/19_18:23:16 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[29345]: 2007/09/19_18:23:16 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[29345]: 2007/09/19_18:23:16 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[29345]: 2007/09/19_18:23:16 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[29345]: 2007/09/19_18:23:16 info: glib: ping group heartbeat started. heartbeat[29345]: 2007/09/19_18:23:16 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[29345]: 2007/09/19_18:23:17 info: Local status now set to: 'up' heartbeat[29345]: 2007/09/19_18:23:18 info: Link local:local up. heartbeat[29345]: 2007/09/19_18:23:18 info: Status update for node local: status ping heartbeat[29345]: 2007/09/19_18:23:18 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[29345]: 2007/09/19_18:23:18 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[29345]: 2007/09/19_18:23:19 info: Comm_now_up(): updating status to active heartbeat[29345]: 2007/09/19_18:23:19 info: Local status now set to: 'active' heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[29356]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 29356) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[29345]: 2007/09/19_18:23:19 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[29345]: 2007/09/19_18:23:19 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 90 ms (> 50 ms) (GSource: 0xa085110) heartbeat[29345]: 2007/09/19_18:23:19 info: Status update for node host-2.awale.qc.ca: status active heartbeat[29357]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 29357) heartbeat[29359]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 29359) cibmon[29356]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[29360]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 29360) heartbeat[29362]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 29362) heartbeat[29363]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 29363) heartbeat[29358]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 29358) crmd[29362]: 2007/09/19_18:23:19 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[29362]: 2007/09/19_18:23:19 info: crmd_init: Starting crmd crmd[29362]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[29362]: 2007/09/19_18:23:19 info: G_main_add_TriggerHandler: Added signal manual handler crmd[29362]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[29361]: 2007/09/19_18:23:19 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 29361) cib[29358]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[29358]: 2007/09/19_18:23:19 info: G_main_add_TriggerHandler: Added signal manual handler cib[29358]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[29358]: 2007/09/19_18:23:19 info: main: Retrieval of a per-action CIB: disabled cib[29358]: 2007/09/19_18:23:19 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[29358]: 2007/09/19_18:23:19 ERROR: validate_cib_digest: Digest comparision failed: 27181a726ed36183fd16e4d3dd86375a vs. 6f899f9b31512d5554ed9d6feb7942ff cib[29358]: 2007/09/19_18:23:19 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml failed! Configuration contents ignored! cib[29358]: 2007/09/19_18:23:19 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml will NOT used. cib[29358]: 2007/09/19_18:23:19 ERROR: readCibXmlFile: Archiving corrupt or unusable configuration to /var/lib/heartbeat/crm/cib.xml.29358 cib[29358]: 2007/09/19_18:23:19 info: archive_file: /var/lib/heartbeat/crm/cib.xml archived as /var/lib/heartbeat/crm/cib.xml.29358 cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... cib[29358]: 2007/09/19_18:23:19 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last cib[29358]: 2007/09/19_18:23:19 ERROR: validate_cib_digest: Digest comparision failed: 27181a726ed36183fd16e4d3dd86375a vs. 6f899f9b31512d5554ed9d6feb7942ff cib[29358]: 2007/09/19_18:23:19 ERROR: readCibXmlFile: Checksum of /var/lib/heartbeat/crm/cib.xml.last failed! Configuration contents ignored! cib[29358]: 2007/09/19_18:23:19 ERROR: readCibXmlFile: Usually this is caused by manually changes, please refer to http://linux-ha.org/v2/faq/cib_changes_detected cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: Continuing but /var/lib/heartbeat/crm/cib.xml.last will NOT used. cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: Continuing with an empty configuration. cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: No value for admin_epoch was specified in the configuration. lrmd[29359]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: The reccomended course of action is to shutdown, run crm_verify and fix any errors it reports. cib[29358]: 2007/09/19_18:23:19 WARN: readCibXmlFile: We will default to zero and continue but may get confused about which configuration to use if multiple nodes are powered up at the same time. cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] cib[29358]: 2007/09/19_18:23:19 info: log_data_element: readCibXmlFile: [on-disk] lrmd[29359]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[29359]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[29359]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[29359]: 2007/09/19_18:23:19 info: Started. cib[29358]: 2007/09/19_18:23:19 notice: readCibXmlFile: Enabling DTD validation on the existing (sane) configuration cib[29358]: 2007/09/19_18:23:19 info: startCib: CIB Initialization completed successfully mgmtd[29363]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[29358]: 2007/09/19_18:23:19 info: cib_register_ha: Signing in with Heartbeat ccm[29357]: 2007/09/19_18:23:19 info: Hostname: host-1.awale.qc.ca cib[29358]: 2007/09/19_18:23:19 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[29358]: 2007/09/19_18:23:19 WARN: cib_init: CCM Activation failed cib[29358]: 2007/09/19_18:23:19 WARN: cib_init: CCM Connection failed 1 times (30 max) mgmtd[29363]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[29363]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 12 mgmtd[29363]: 2007/09/19_18:23:19 info: init_crm stonithd[29360]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[29360]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[29360]: 2007/09/19_18:23:19 info: Signing in with heartbeat. attrd[29361]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[29360]: 2007/09/19_18:23:19 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[29360]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[29361]: 2007/09/19_18:23:19 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[29361]: 2007/09/19_18:23:19 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 ccm[29357]: 2007/09/19_18:23:19 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[29358]: 2007/09/19_18:23:20 info: cib_init: Starting cib mainloop cibmon[29356]: 2007/09/19_18:23:20 info: main: Starting mainloop crmd[29362]: 2007/09/19_18:23:20 info: do_cib_control: CIB connection established cib[29358]: 2007/09/19_18:23:20 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[29358]: 2007/09/19_18:23:20 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on crmd[29362]: 2007/09/19_18:23:20 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[29364]: 2007/09/19_18:23:20 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: b0b60531e212b1ef9b5bc71c85815b38) cib[29358]: 2007/09/19_18:23:20 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[29358]: 2007/09/19_18:23:20 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[29358]: 2007/09/19_18:23:20 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on crmd[29362]: 2007/09/19_18:23:21 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[29358]: 2007/09/19_18:23:21 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[29362]: 2007/09/19_18:23:21 info: populate_cib_nodes: Requesting the list of configured nodes crmd[29362]: 2007/09/19_18:23:22 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) mgmtd[29363]: 2007/09/19_18:23:22 info: Started. crmd[29362]: 2007/09/19_18:23:23 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[29362]: 2007/09/19_18:23:23 info: do_ha_control: Connected to Heartbeat crmd[29362]: 2007/09/19_18:23:23 info: do_ccm_control: CCM connection established... waiting for first callback cibmon[29356]: 2007/09/19_18:23:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[29362]: 2007/09/19_18:23:23 info: do_started: Delaying start, CCM (0000000000100000) not connected cibmon[29356]: 2007/09/19_18:23:23 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 crmd[29362]: 2007/09/19_18:23:23 info: crmd_init: Starting crmd's mainloop cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + crmd[29362]: 2007/09/19_18:23:23 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cib[29365]: 2007/09/19_18:23:23 info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 86d69baa672d1ca34d0d1f043e2e7090) crmd[29362]: 2007/09/19_18:23:23 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[29356]: 2007/09/19_18:23:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:23:23 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + crmd[29362]: 2007/09/19_18:23:23 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] crmd[29362]: 2007/09/19_18:23:23 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[29362]: 2007/09/19_18:23:23 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[29362]: 2007/09/19_18:23:23 info: do_started: Delaying start, CCM (0000000000100000) not connected cibmon[29356]: 2007/09/19_18:23:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:23:23 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:23 info: log_data_element: cib_update: + attrd[29361]: 2007/09/19_18:23:25 info: main: Starting mainloop... crmd[29362]: 2007/09/19_18:23:30 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[29362]: 2007/09/19_18:23:30 info: mem_handle_event: instance=8, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[29358]: 2007/09/19_18:23:30 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[29362]: 2007/09/19_18:23:30 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=8) cib[29358]: 2007/09/19_18:23:30 info: mem_handle_event: instance=8, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[29362]: 2007/09/19_18:23:30 info: ccm_event_detail: NEW MEMBERSHIP: trans=8, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 cib[29358]: 2007/09/19_18:23:30 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:23:30 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=4] cib[29358]: 2007/09/19_18:23:30 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:23:30 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=8] crmd[29362]: 2007/09/19_18:23:30 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=4] crmd[29362]: 2007/09/19_18:23:30 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=8] crmd[29362]: 2007/09/19_18:23:30 info: do_started: The local CRM is operational crmd[29362]: 2007/09/19_18:23:30 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[29362]: 2007/09/19_18:23:30 info: update_dc: Set DC to () cibmon[29356]: 2007/09/19_18:23:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:23:30 info: log_cib_diff: cib_update: Local-only Change: 0.0.0 cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:23:30 info: log_data_element: cib_update: + crmd[29362]: 2007/09/19_18:23:32 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[29362]: 2007/09/19_18:23:33 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[29362]: 2007/09/19_18:23:33 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[29358]: 2007/09/19_18:23:33 info: cib_replace_notify: Replaced: 0.0.0 -> 0.17.34 from crmd[29362]: 2007/09/19_18:23:33 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[29356]: 2007/09/19_18:23:33 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[29356]: 2007/09/19_18:23:33 info: log_cib_diff: cib_replace: Diff: --- 0.0.0 cibmon[29356]: 2007/09/19_18:23:33 info: log_cib_diff: cib_replace: Diff: +++ 0.17.34 cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:33 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cib[29366]: 2007/09/19_18:23:34 info: write_cib_contents: Wrote version 0.17.37 of the CIB to disk (digest: 21b4f6944afbeed479cc346a96a3c7c9) cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:23:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.34 cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.35 cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.35 cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.36 cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.36 cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.37 cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:34 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.37 cibmon[29356]: 2007/09/19_18:23:34 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.38 cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:34 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:34 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[29362]: 2007/09/19_18:23:35 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[29362]: 2007/09/19_18:23:35 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=12:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:35 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=13:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.38 cibmon[29356]: 2007/09/19_18:23:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.39 cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:35 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=14:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:35 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=15:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:36 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=16:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:36 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=17:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:36 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=18:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:35 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:35 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.39 cibmon[29356]: 2007/09/19_18:23:35 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.40 cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:36 info: do_lrm_rsc_op: Performing op=child_DoFencing:1_monitor_0 key=20:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:36 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_0 key=19:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:35 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.40 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.41 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.41 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.42 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:36 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=4, rc=7) complete crmd[29362]: 2007/09/19_18:23:36 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=3, rc=7) complete cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.42 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.43 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.43 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.44 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.44 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.45 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:36 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.45 cibmon[29356]: 2007/09/19_18:23:36 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.46 cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:36 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:36 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=5, rc=7) complete crmd[29362]: 2007/09/19_18:23:36 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=2, rc=7) complete crmd[29362]: 2007/09/19_18:23:37 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=6, rc=7) complete crmd[29362]: 2007/09/19_18:23:37 info: process_lrm_event: LRM operation child_DoFencing:1_monitor_0 (call=9, rc=7) complete cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.46 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.47 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.47 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.48 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:23:37 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=8, rc=7) complete cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.48 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.49 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.49 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.50 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.50 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.51 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.51 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.52 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.52 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.53 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.53 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.54 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:37 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=7, rc=7) complete cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.54 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.55 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.55 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.56 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.56 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.57 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.57 cibmon[29356]: 2007/09/19_18:23:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.58 cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:37 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:38 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_0 (call=10, rc=7) complete cibmon[29356]: 2007/09/19_18:23:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.58 cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.59 cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.59 cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.60 cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.60 cibmon[29356]: 2007/09/19_18:23:38 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.61 cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:38 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:39 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.61 cibmon[29356]: 2007/09/19_18:23:39 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.62 cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:39 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:39 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=22:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:39 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=48:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) lrmd[29467]: 2007/09/19_18:23:39 info: Try to start STONITH resource : Device=apcsnmp stonithd[29479]: 2007/09/19_18:23:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[29479]: 2007/09/19_18:23:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[29362]: 2007/09/19_18:23:40 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=12, rc=0) complete crmd[29362]: 2007/09/19_18:23:40 info: build_operation_update: Digest for 0:0;48:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[29362]: 2007/09/19_18:23:40 info: log_data_element: build_operation_update: digest:source lrmd[29359]: 2007/09/19_18:23:40 WARN: stonithRA plugin: cannot get shortdesc segment of apcsnmp's metadata. stonithd[29360]: 2007/09/19_18:23:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' msg[29466][29489]: 2007/09/19_18:23:40 INFO Starting to switch to this node. stonithd[29360]: 2007/09/19_18:23:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' msg[29466][29490]: 2007/09/19_18:23:40 INFO Node: host-1.awale.qc.ca stonithd[29360]: 2007/09/19_18:23:40 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 340 ms (> 30 ms) (GSource: 0x810ecf0) crmd[29362]: 2007/09/19_18:23:40 info: process_lrm_event: LRM operation msg_first_start_0 (call=11, rc=0) complete crmd[29362]: 2007/09/19_18:23:40 info: build_operation_update: Digest for 0:0;22:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[29362]: 2007/09/19_18:23:40 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:23:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.62 cibmon[29356]: 2007/09/19_18:23:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.63 cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:41 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.63 cibmon[29356]: 2007/09/19_18:23:41 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.64 cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:41 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:42 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=6:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:42 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_50000 key=26:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:42 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.64 cibmon[29356]: 2007/09/19_18:23:42 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.65 cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:42 info: log_data_element: cib_apply_diff: + stonithd[29502]: 2007/09/19_18:23:42 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[29502]: 2007/09/19_18:23:42 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[29362]: 2007/09/19_18:23:42 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=14, rc=0) complete msg[29500][29523]: 2007/09/19_18:23:42 INFO Starting to switch to this node. msg[29500][29524]: 2007/09/19_18:23:42 INFO Node: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:23:42 info: process_lrm_event: LRM operation msg_first_start_0 (call=13, rc=0) complete crmd[29362]: 2007/09/19_18:23:42 info: build_operation_update: Digest for 0:0;6:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[29362]: 2007/09/19_18:23:42 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:23:43 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=7:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=8:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.65 cibmon[29356]: 2007/09/19_18:23:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.66 cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.66 cibmon[29356]: 2007/09/19_18:23:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.67 cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:43 info: log_data_element: cib_apply_diff: + daemontools[29535][29555]: 2007/09/19_18:23:44 INFO Starting vmstat-mon crmd[29362]: 2007/09/19_18:23:44 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=16, rc=0) complete crmd[29362]: 2007/09/19_18:23:44 info: build_operation_update: Digest for 0:0;8:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[29362]: 2007/09/19_18:23:44 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:23:44 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=15, rc=0) complete crmd[29362]: 2007/09/19_18:23:45 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=9:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:45 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=10:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.67 cibmon[29356]: 2007/09/19_18:23:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.68 cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.68 cibmon[29356]: 2007/09/19_18:23:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.69 cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:45 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:46 info: process_lrm_event: LRM operation share-drbd_start_0 (call=18, rc=0) complete crmd[29362]: 2007/09/19_18:23:46 info: build_operation_update: Digest for 0:0;10:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[29362]: 2007/09/19_18:23:46 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:23:46 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=17, rc=0) complete crmd[29362]: 2007/09/19_18:23:46 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=11:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:46 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=12:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.69 cibmon[29356]: 2007/09/19_18:23:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.70 cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:46 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.70 cibmon[29356]: 2007/09/19_18:23:46 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.71 cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:46 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:46 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=19, rc=0) complete Filesystem[29581][29613]: 2007/09/19_18:23:47 INFO: Running start for /dev/drbd0 on /share crmd[29362]: 2007/09/19_18:23:47 info: process_lrm_event: LRM operation share-FS_start_0 (call=20, rc=0) complete crmd[29362]: 2007/09/19_18:23:47 info: build_operation_update: Digest for 0:0;12:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:23:47 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:23:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.71 cibmon[29356]: 2007/09/19_18:23:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.72 cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:47 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:48 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=13:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=14:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:48 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.72 cibmon[29356]: 2007/09/19_18:23:48 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.73 cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:48 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:49 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=22, rc=0) complete crmd[29362]: 2007/09/19_18:23:49 info: build_operation_update: Digest for 0:0;14:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[29362]: 2007/09/19_18:23:49 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:23:49 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=21, rc=0) complete crmd[29362]: 2007/09/19_18:23:49 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=15:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:49 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=16:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:49 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:49 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.73 cibmon[29356]: 2007/09/19_18:23:49 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.74 cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:49 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:50 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=23, rc=0) complete IPaddr[29672][29704]: 2007/09/19_18:23:50 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[29672][29709]: 2007/09/19_18:23:50 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 cibmon[29356]: 2007/09/19_18:23:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.74 cibmon[29356]: 2007/09/19_18:23:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.75 cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:50 info: log_data_element: cib_apply_diff: + IPaddr[29672][29731]: 2007/09/19_18:23:50 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[29362]: 2007/09/19_18:23:50 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=24, rc=0) complete crmd[29362]: 2007/09/19_18:23:50 info: build_operation_update: Digest for 0:0;16:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[29362]: 2007/09/19_18:23:50 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:23:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.75 cibmon[29356]: 2007/09/19_18:23:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.76 cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:51 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=17:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:23:51 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=18:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.76 cibmon[29356]: 2007/09/19_18:23:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.77 cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:51 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:52 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=25, rc=0) complete msg[29763][29797]: 2007/09/19_18:23:52 INFO Completed switching to this node. msg[29763][29798]: 2007/09/19_18:23:52 INFO Node: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:23:52 info: process_lrm_event: LRM operation msg_last_start_0 (call=26, rc=0) complete crmd[29362]: 2007/09/19_18:23:52 info: build_operation_update: Digest for 0:0;18:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[29362]: 2007/09/19_18:23:52 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:23:52 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=19:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:23:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.77 cibmon[29356]: 2007/09/19_18:23:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.78 cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.78 cibmon[29356]: 2007/09/19_18:23:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.79 cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:52 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:23:53 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=27, rc=0) complete cibmon[29356]: 2007/09/19_18:23:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:23:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.79 cibmon[29356]: 2007/09/19_18:23:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.80 cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:23:53 info: log_data_element: cib_apply_diff: + stonithd[29360]: 2007/09/19_18:24:19 WARN: Performed 1 more non-realtime malloc calls. stonithd[29360]: 2007/09/19_18:24:19 info: Total non-realtime malloc bytes: 135168 stonithd[29934]: 2007/09/19_18:24:32 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[29934]: 2007/09/19_18:24:32 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[29356]: 2007/09/19_18:24:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:24:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.80 cibmon[29356]: 2007/09/19_18:24:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.17.81 cibmon[29356]: 2007/09/19_18:24:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:37 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:24:43 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=37:8:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:24:43 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=17, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:24:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:24:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.17.81 cibmon[29356]: 2007/09/19_18:24:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.18.1 cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:43 info: log_data_element: cib_apply_diff: + daemontools[29967][29978]: 2007/09/19_18:24:43 INFO Stoping vmstat-mon crmd[29362]: 2007/09/19_18:24:43 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=28, rc=0) complete cib[29972]: 2007/09/19_18:24:43 info: write_cib_contents: Wrote version 0.18.1 of the CIB to disk (digest: 01b1e326e9846f91f71c0a1b61a57c35) cibmon[29356]: 2007/09/19_18:24:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:24:44 info: log_cib_diff: cib_apply_diff: Diff: --- 0.18.1 cibmon[29356]: 2007/09/19_18:24:44 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.18.2 cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:24:45 info: log_cib_diff: cib_apply_diff: Diff: --- 0.18.2 cibmon[29356]: 2007/09/19_18:24:45 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.18.3 cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:24:45 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:25:04 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=34:9:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:25:04 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=27, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:25:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.18.3 cibmon[29356]: 2007/09/19_18:25:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.19.1 cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:04 info: log_data_element: cib_apply_diff: + msg[30042][30065]: 2007/09/19_18:25:04 INFO Starting to switch away from this node. msg[30042][30067]: 2007/09/19_18:25:04 INFO Node: host-1.awale.qc.ca cib[30044]: 2007/09/19_18:25:04 info: write_cib_contents: Wrote version 0.19.1 of the CIB to disk (digest: 835a1f4727398fdb911536d853cf1d6a) crmd[29362]: 2007/09/19_18:25:04 info: process_lrm_event: LRM operation msg_last_stop_0 (call=29, rc=0) complete cibmon[29356]: 2007/09/19_18:25:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.19.1 cibmon[29356]: 2007/09/19_18:25:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.19.2 cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.19.2 cibmon[29356]: 2007/09/19_18:25:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.19.3 cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:05 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:25:15 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=31:10:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:25:15 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=15, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:25:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.19.3 cibmon[29356]: 2007/09/19_18:25:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.20.1 cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:15 info: log_data_element: cib_apply_diff: + msg[30119][30142]: 2007/09/19_18:25:16 INFO Completed switching away from this node. msg[30119][30143]: 2007/09/19_18:25:16 INFO Node: host-1.awale.qc.ca cib[30120]: 2007/09/19_18:25:16 info: write_cib_contents: Wrote version 0.20.1 of the CIB to disk (digest: 73b67a117c1c1d9728d4de323eef024d) crmd[29362]: 2007/09/19_18:25:16 info: process_lrm_event: LRM operation msg_first_stop_0 (call=30, rc=0) complete cibmon[29356]: 2007/09/19_18:25:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.20.1 cibmon[29356]: 2007/09/19_18:25:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.20.2 cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.20.2 cibmon[29356]: 2007/09/19_18:25:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.20.3 cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:17 info: log_data_element: cib_apply_diff: + stonithd[30176]: 2007/09/19_18:25:22 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[30176]: 2007/09/19_18:25:22 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[29362]: 2007/09/19_18:25:32 info: do_lrm_rsc_op: Performing op=share-drbd_stop_0 key=28:11:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:25:32 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=19, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:25:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.20.3 cibmon[29356]: 2007/09/19_18:25:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.21.1 cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) ioctl(,SET_STATE,) failed: cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: - lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) Device or resource busy cibmon[29356]: 2007/09/19_18:25:32 info: log_data_element: cib_apply_diff: + lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) Someone has opened the device for RW access! lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) Command ' lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) /sbin/drbdsetup lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) /dev/drbd0 lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) crmd[29362]: 2007/09/19_18:25:32 ERROR: process_lrm_event: LRM operation share-drbd_stop_0 (call=31, rc=20) Error lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) secondary lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) ' terminated with exit code 20 lrmd[29359]: 2007/09/19_18:25:32 info: RA output: (share-drbd:stop:stderr) drbdadm aborting cib[30210]: 2007/09/19_18:25:32 info: write_cib_contents: Wrote version 0.21.1 of the CIB to disk (digest: 185b8f28d1609d82516b7ca2ea4f7f91) cibmon[29356]: 2007/09/19_18:25:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.21.1 cibmon[29356]: 2007/09/19_18:25:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.21.2 cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.21.2 cibmon[29356]: 2007/09/19_18:25:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.21.3 cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:33 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:25:37 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:37 info: log_cib_diff: cib_apply_diff: Diff: --- 0.21.3 cibmon[29356]: 2007/09/19_18:25:37 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.22.1 cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:37 info: log_data_element: cib_apply_diff: + cib[30228]: 2007/09/19_18:25:37 info: write_cib_contents: Wrote version 0.22.1 of the CIB to disk (digest: a766408c9f4e1ccae092b5cc6d66d102) cibmon[29356]: 2007/09/19_18:25:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:45 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.23.1 cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:45 info: log_data_element: cib_apply_diff: + cib[30245]: 2007/09/19_18:25:45 info: write_cib_contents: Wrote version 0.23.1 of the CIB to disk (digest: 014fb67635257c2e521474a8f86a2e50) cibmon[29356]: 2007/09/19_18:25:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:25:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.23.1 cibmon[29356]: 2007/09/19_18:25:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.23.2 cibmon[29356]: 2007/09/19_18:25:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:25:53 info: log_data_element: cib_apply_diff: + stonithd[30370]: 2007/09/19_18:26:12 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[30370]: 2007/09/19_18:26:12 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[29356]: 2007/09/19_18:26:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:43 info: log_cib_diff: cib_apply_diff: Diff: --- 0.23.2 cibmon[29356]: 2007/09/19_18:26:43 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.24.1 cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:43 info: log_data_element: cib_apply_diff: + cib[30456]: 2007/09/19_18:26:43 info: write_cib_contents: Wrote version 0.24.1 of the CIB to disk (digest: c56f339ba80347e2cb3be3515adf55ac) cibmon[29356]: 2007/09/19_18:26:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:45 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.25.1 cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:45 info: log_data_element: cib_apply_diff: + cib[30458]: 2007/09/19_18:26:45 info: write_cib_contents: Wrote version 0.25.1 of the CIB to disk (digest: 6fe755b08de2a05494182bd42afa3d74) cibmon[29356]: 2007/09/19_18:26:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:46 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.26.1 cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:46 info: log_data_element: cib_apply_diff: + cib[30460]: 2007/09/19_18:26:46 info: write_cib_contents: Wrote version 0.26.1 of the CIB to disk (digest: be4b0860ddcd49e3e268833f1fdb9e01) cibmon[29356]: 2007/09/19_18:26:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:48 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.27.1 cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:48 info: log_data_element: cib_apply_diff: + cib[30476]: 2007/09/19_18:26:48 info: write_cib_contents: Wrote version 0.27.1 of the CIB to disk (digest: cdc4b8ede475c3350958741ffcad302c) cibmon[29356]: 2007/09/19_18:26:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:50 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.28.1 cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:50 info: log_data_element: cib_apply_diff: + cib[30479]: 2007/09/19_18:26:50 info: write_cib_contents: Wrote version 0.28.1 of the CIB to disk (digest: f9d61dddc5529e2c8870b011a4cb5a75) cibmon[29356]: 2007/09/19_18:26:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:51 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.29.1 cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:51 info: log_data_element: cib_apply_diff: + cib[30480]: 2007/09/19_18:26:51 info: write_cib_contents: Wrote version 0.29.1 of the CIB to disk (digest: 69f7fea266333576f55b6febc3e89a6e) cibmon[29356]: 2007/09/19_18:26:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:26:52 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.30.1 cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:26:52 info: log_data_element: cib_apply_diff: + cib[30482]: 2007/09/19_18:26:52 info: write_cib_contents: Wrote version 0.30.1 of the CIB to disk (digest: a0231445ac20d9409fa45d617a9e0d7d) stonithd[30514]: 2007/09/19_18:27:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[30514]: 2007/09/19_18:27:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.1 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.2 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.2 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.3 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.3 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.4 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.4 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.5 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.5 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.6 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.6 cibmon[29356]: 2007/09/19_18:27:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.30.7 cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:27:05 info: log_data_element: cib_apply_diff: + stonithd[30708]: 2007/09/19_18:27:52 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[30708]: 2007/09/19_18:27:52 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[29356]: 2007/09/19_18:28:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.30.7 cibmon[29356]: 2007/09/19_18:28:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.32.1 cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cib[30742]: 2007/09/19_18:28:04 info: write_cib_contents: Wrote version 0.32.1 of the CIB to disk (digest: 67c80fa36c26d86f0740801392e241c0) cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:04 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:05 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:05 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:05 info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[29362]: 2007/09/19_18:28:05 info: update_dc: Set DC to () cibmon[29356]: 2007/09/19_18:28:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.32.1 cibmon[29356]: 2007/09/19_18:28:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.32.2 cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:05 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:28:05 info: apply_xml_diff: Diff application failed! cib[29358]: 2007/09/19_18:28:05 info: cib_process_diff: Diff 0.32.2 -> 0.34.1 not applied to 0.32.2: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:05 info: cib_process_diff: Requesting re-sync from peer: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:05 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:05 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh crmd[29362]: 2007/09/19_18:28:07 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca cib[29358]: 2007/09/19_18:28:07 info: cib_replace_notify: Replaced: 0.32.2 -> 0.34.1 from crmd[29362]: 2007/09/19_18:28:07 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:07 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[29356]: 2007/09/19_18:28:07 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[29356]: 2007/09/19_18:28:07 info: log_cib_diff: cib_replace: Diff: --- 0.32.2 cibmon[29356]: 2007/09/19_18:28:07 info: log_cib_diff: cib_replace: Diff: +++ 0.34.1 cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.34.1 cibmon[29356]: 2007/09/19_18:28:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.34.2 cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:07 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[29362]: 2007/09/19_18:28:07 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) cibmon[29356]: 2007/09/19_18:28:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:28:07 info: log_cib_diff: cib_update: Local-only Change: 0.34.2 cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:07 info: log_data_element: cib_update: + cib[30758]: 2007/09/19_18:28:07 info: write_cib_contents: Wrote version 0.34.2 of the CIB to disk (digest: 0feccad50fe878b51f005ed1b05f3a9e) crmd[29362]: 2007/09/19_18:28:08 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[29356]: 2007/09/19_18:28:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.34.2 cibmon[29356]: 2007/09/19_18:28:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.34.3 cibmon[29356]: 2007/09/19_18:28:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.34.3 cibmon[29356]: 2007/09/19_18:28:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.36.1 cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:13 info: log_data_element: cib_apply_diff: + cib[30774]: 2007/09/19_18:28:13 info: write_cib_contents: Wrote version 0.36.1 of the CIB to disk (digest: 8c9aa520cda62d1efc64ca6a50e6dc8f) crmd[29362]: 2007/09/19_18:28:15 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:15 info: update_dc: Set DC to () cibmon[29356]: 2007/09/19_18:28:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.36.1 cibmon[29356]: 2007/09/19_18:28:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.37.2 cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:15 info: log_cib_diff: cib_apply_diff: Diff: --- 0.37.2 cibmon[29356]: 2007/09/19_18:28:15 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.37.3 cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:15 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:28:15 info: apply_xml_diff: Diff application failed! cib[29358]: 2007/09/19_18:28:15 info: cib_process_diff: Diff 0.37.3 -> 0.39.1 not applied to 0.37.3: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:15 info: cib_process_diff: Requesting re-sync from peer: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:15 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:15 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:16 WARN: cib_process_diff: Not applying diff 0.39.1 -> 0.39.2 (sync in progress) cib[29358]: 2007/09/19_18:28:16 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:16 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:17 info: cib_replace_notify: Replaced: 0.37.3 -> 0.39.2 from crmd[29362]: 2007/09/19_18:28:17 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[29356]: 2007/09/19_18:28:17 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_replace: Diff: --- 0.37.3 cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_replace: Diff: +++ 0.39.2 cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.39.2 cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.41.1 cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cib[30792]: 2007/09/19_18:28:17 info: write_cib_contents: Wrote version 0.41.1 of the CIB to disk (digest: 46ac8ecce39e75dbfe370c08b2a4d2bf) crmd[29362]: 2007/09/19_18:28:17 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) cibmon[29356]: 2007/09/19_18:28:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.41.1 cib[29358]: 2007/09/19_18:28:17 info: apply_xml_diff: Diff application failed! cibmon[29356]: 2007/09/19_18:28:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.41.2 cib[29358]: 2007/09/19_18:28:17 info: cib_process_diff: Diff 0.41.2 -> 0.43.1 not applied to 0.41.2: Failed application of a global update. Requesting full refresh. cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: - cib[29358]: 2007/09/19_18:28:17 info: cib_process_diff: Requesting re-sync from peer: Failed application of a global update. Requesting full refresh. cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:28:17 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:28:17 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:17 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:18 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) cibmon[29356]: 2007/09/19_18:28:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:28:18 info: log_cib_diff: cib_update: Local-only Change: 0.41.2 cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:18 info: log_data_element: cib_update: + cib[30795]: 2007/09/19_18:28:18 info: write_cib_contents: Wrote version 0.41.2 of the CIB to disk (digest: bc7f51c2572efb6f2b6e6897a7fb0371) crmd[29362]: 2007/09/19_18:28:19 info: populate_cib_nodes: Requesting the list of configured nodes cib[29358]: 2007/09/19_18:28:19 info: cib_replace_notify: Replaced: 0.41.2 -> 0.43.1 from cibmon[29356]: 2007/09/19_18:28:19 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_replace: Diff: --- 0.41.2 cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_replace: Diff: +++ 0.43.1 cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.43.1 cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.44.2 cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.44.2 cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.44.3 cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cib[30796]: 2007/09/19_18:28:19 info: write_cib_contents: Wrote version 0.44.3 of the CIB to disk (digest: ce8d8e234aa238a7463a911d7b89d27e) crmd[29362]: 2007/09/19_18:28:19 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[29362]: 2007/09/19_18:28:19 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) cibmon[29356]: 2007/09/19_18:28:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.44.3 cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.44.4 cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:28:19 info: apply_xml_diff: Diff application failed! cib[29358]: 2007/09/19_18:28:19 info: cib_process_diff: Diff 0.44.4 -> 0.46.1 not applied to 0.44.4: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:19 info: cib_process_diff: Requesting re-sync from peer: Failed application of a global update. Requesting full refresh. cib[29358]: 2007/09/19_18:28:19 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:19 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh cibmon[29356]: 2007/09/19_18:28:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:28:19 info: log_cib_diff: cib_update: Local-only Change: 0.44.4 cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:19 info: log_data_element: cib_update: + cib[30799]: 2007/09/19_18:28:20 info: write_cib_contents: Wrote version 0.44.4 of the CIB to disk (digest: c97422af876701d55af46aef2c34e685) cib[29358]: 2007/09/19_18:28:20 WARN: cib_process_diff: Not applying diff 0.46.1 -> 0.46.2 (sync in progress) cib[29358]: 2007/09/19_18:28:20 WARN: do_cib_notify: cib_apply_diff of FAILED: Application of an update diff failed, requesting a full refresh cib[29358]: 2007/09/19_18:28:20 WARN: cib_process_request: cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh crmd[29362]: 2007/09/19_18:28:20 info: populate_cib_nodes: Requesting the list of configured nodes cib[29358]: 2007/09/19_18:28:20 info: cib_replace_notify: Replaced: 0.44.4 -> 0.46.2 from cibmon[29356]: 2007/09/19_18:28:20 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[29356]: 2007/09/19_18:28:20 info: log_cib_diff: cib_replace: Diff: --- 0.44.4 cibmon[29356]: 2007/09/19_18:28:20 info: log_cib_diff: cib_replace: Diff: +++ 0.46.2 cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_replace: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_replace: + cibmon[29356]: 2007/09/19_18:28:20 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:20 info: log_cib_diff: cib_apply_diff: Diff: --- 0.46.2 cibmon[29356]: 2007/09/19_18:28:20 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.1 cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:20 info: log_data_element: cib_apply_diff: + cib[30800]: 2007/09/19_18:28:21 info: write_cib_contents: Wrote version 0.48.1 of the CIB to disk (digest: a7abbb28ef825548df1e4b1880245298) crmd[29362]: 2007/09/19_18:28:21 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[29362]: 2007/09/19_18:28:21 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) cibmon[29356]: 2007/09/19_18:28:21 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:21 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.1 cibmon[29356]: 2007/09/19_18:28:21 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.2 cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[29356]: 2007/09/19_18:28:21 info: log_cib_diff: cib_update: Local-only Change: 0.48.2 cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:21 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_update: + cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_update: + cib[30816]: 2007/09/19_18:28:22 info: write_cib_contents: Wrote version 0.48.2 of the CIB to disk (digest: 30c109ccd6a982c4219631b082dd4f1f) crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 ERROR: crm_abort: update_dc: Triggered non-fatal assert at utils.c:1453 : fsa_our_dc != NULL crmd[29362]: 2007/09/19_18:28:22 ERROR: crm_abort: update_dc: Triggered non-fatal assert at utils.c:1454 : safe_str_eq(fsa_our_dc, welcome_from) cibmon[29356]: 2007/09/19_18:28:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.2 cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.3 cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.3 cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.4 cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.4 cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.5 cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;6:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:22 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.5 cibmon[29356]: 2007/09/19_18:28:22 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.6 cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:22 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;18:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;8:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;16:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;48:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;10:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;12:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: build_operation_update: Digest for 0:0;14:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[29362]: 2007/09/19_18:28:22 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:22 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:22 info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[29362]: 2007/09/19_18:28:22 info: update_dc: Set DC to () crmd[29362]: 2007/09/19_18:28:23 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[29356]: 2007/09/19_18:28:23 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:23 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.6 cibmon[29356]: 2007/09/19_18:28:23 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.7 cibmon[29356]: 2007/09/19_18:28:23 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:23 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:24 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[29356]: 2007/09/19_18:28:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[29362]: 2007/09/19_18:28:24 info: build_operation_update: Digest for 0:0;6:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 cibmon[29356]: 2007/09/19_18:28:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.7 crmd[29362]: 2007/09/19_18:28:24 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.8 crmd[29362]: 2007/09/19_18:28:24 info: build_operation_update: Digest for 0:0;18:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 cibmon[29356]: 2007/09/19_18:28:24 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:28:24 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:24 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:24 info: build_operation_update: Digest for 0:0;8:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 cibmon[29356]: 2007/09/19_18:28:24 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[29362]: 2007/09/19_18:28:24 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:24 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.8 cibmon[29356]: 2007/09/19_18:28:24 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.9 cibmon[29356]: 2007/09/19_18:28:24 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:24 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:25 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[29362]: 2007/09/19_18:28:25 info: build_operation_update: Digest for 0:0;16:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 cibmon[29356]: 2007/09/19_18:28:25 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.9 crmd[29362]: 2007/09/19_18:28:25 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:25 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.10 cibmon[29356]: 2007/09/19_18:28:25 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:25 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:25 info: build_operation_update: Digest for 0:0;48:6:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[29362]: 2007/09/19_18:28:25 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:25 info: build_operation_update: Digest for 0:0;10:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[29362]: 2007/09/19_18:28:25 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:25 info: build_operation_update: Digest for 0:0;12:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:28:25 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:25 info: build_operation_update: Digest for 0:0;14:7:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[29362]: 2007/09/19_18:28:25 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:25 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cibmon[29356]: 2007/09/19_18:28:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.10 cibmon[29356]: 2007/09/19_18:28:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.11 cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:26 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:26 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=15:18:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:28:27 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_stop_0 key=16:18:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:28:27 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=19:18:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.11 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.12 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:27 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=20:18:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + lrmd[30832]: 2007/09/19_18:28:27 info: Try to stop STONITH resource : Device=apcsnmp cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.12 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.13 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.13 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.14 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.14 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.15 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.15 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.16 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.16 cibmon[29356]: 2007/09/19_18:28:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.17 cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:27 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=25, rc=-2) Cancelled crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=14, rc=-2) Cancelled crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=21, rc=-2) Cancelled crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=23, rc=-2) Cancelled crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation child_DoFencing:0_stop_0 (call=33, rc=0) complete crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=35, rc=0) complete lrmd[29359]: 2007/09/19_18:28:27 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[29359]: 2007/09/19_18:28:27 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[30831][30872]: 2007/09/19_18:28:27 INFO: ifconfig eth0:0 down crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=32, rc=0) complete Filesystem[30833][30884]: 2007/09/19_18:28:27 INFO: Running stop for /dev/drbd0 on /share Filesystem[30833][30894]: 2007/09/19_18:28:27 INFO: Trying to unmount /share Filesystem[30833][30896]: 2007/09/19_18:28:27 INFO: unmounted /share successfully crmd[29362]: 2007/09/19_18:28:27 info: process_lrm_event: LRM operation share-FS_stop_0 (call=34, rc=0) complete cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.17 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.18 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.18 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.19 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.19 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.20 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.20 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.21 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.21 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.22 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.22 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.23 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.23 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.24 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.24 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.25 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.25 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.26 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.26 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.27 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.27 cibmon[29356]: 2007/09/19_18:28:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.28 cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:28 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.28 cibmon[29356]: 2007/09/19_18:28:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.29 cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.29 cibmon[29356]: 2007/09/19_18:28:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.48.30 cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:29 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:47 info: log_cib_diff: cib_apply_diff: Diff: --- 0.48.30 cibmon[29356]: 2007/09/19_18:28:47 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.49.1 cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:47 info: log_data_element: cib_apply_diff: + cib[30908]: 2007/09/19_18:28:47 info: write_cib_contents: Wrote version 0.49.1 of the CIB to disk (digest: 611f1990d113b4a0068f2073e20c085a) crmd[29362]: 2007/09/19_18:28:48 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=6:21:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:48 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:48 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.50.1 cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:48 info: log_data_element: cib_apply_diff: + cib[30914]: 2007/09/19_18:28:48 info: write_cib_contents: Wrote version 0.50.1 of the CIB to disk (digest: 385c56b608f5090b1f953d80b2f5e47c) lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) Traceback (most recent call last): lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) File "/etc/ha.d/resource.d//drbdlinks", line 250, in ? lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) st = os.stat(linkDest) lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) OSError lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) : lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) [Errno 2] No such file or directory: '/share/mysql' lrmd[29359]: 2007/09/19_18:28:48 info: RA output: (share-drbdlinks:start:stderr) crmd[29362]: 2007/09/19_18:28:48 ERROR: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=36, rc=1) Error unknown error crmd[29362]: 2007/09/19_18:28:48 info: build_operation_update: Digest for 4:1;6:21:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[29362]: 2007/09/19_18:28:48 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:28:50 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=1:22:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:50 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:50 info: log_cib_diff: cib_apply_diff: Diff: --- 0.50.1 cibmon[29356]: 2007/09/19_18:28:50 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.50.2 cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:50 info: log_data_element: cib_apply_diff: + lrmd[29359]: 2007/09/19_18:28:50 info: RA output: (share-drbdlinks:stop:stderr) umount: /var/lib/mysql: not found crmd[29362]: 2007/09/19_18:28:50 info: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=37, rc=0) complete crmd[29362]: 2007/09/19_18:28:51 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=7:23:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.50.2 cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.50.3 cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.50.3 cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.51.1 cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.51.1 cibmon[29356]: 2007/09/19_18:28:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.51.2 cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:51 info: log_data_element: cib_apply_diff: + cib[30922]: 2007/09/19_18:28:51 info: write_cib_contents: Wrote version 0.51.2 of the CIB to disk (digest: 2cc25b7d063e4d40bdf4935a4a68dc7f) Filesystem[30920][30951]: 2007/09/19_18:28:51 INFO: Running start for /dev/drbd0 on /share crmd[29362]: 2007/09/19_18:28:51 info: process_lrm_event: LRM operation share-FS_start_0 (call=38, rc=0) complete crmd[29362]: 2007/09/19_18:28:51 info: build_operation_update: Digest for 0:0;7:23:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:28:51 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:28:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.51.2 cibmon[29356]: 2007/09/19_18:28:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.51.3 cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:52 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=8:23:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.51.3 cibmon[29356]: 2007/09/19_18:28:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.51.4 cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:53 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:53 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=39, rc=0) complete cibmon[29356]: 2007/09/19_18:28:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.51.4 cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.52.1 cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.52.1 cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.52.2 cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.52.2 cibmon[29356]: 2007/09/19_18:28:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.52.3 cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:54 info: log_data_element: cib_apply_diff: + cib[31000]: 2007/09/19_18:28:54 info: write_cib_contents: Wrote version 0.52.3 of the CIB to disk (digest: 50ad317de6f94069cf23153a99397965) cibmon[29356]: 2007/09/19_18:28:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.52.3 cibmon[29356]: 2007/09/19_18:28:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.52.4 cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:55 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:56 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=6:25:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:28:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.52.4 cibmon[29356]: 2007/09/19_18:28:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.53.1 cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:56 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:56 info: process_lrm_event: LRM operation mysql_monitor_0 (call=40, rc=7) complete cib[31002]: 2007/09/19_18:28:56 info: write_cib_contents: Wrote version 0.53.1 of the CIB to disk (digest: bf0c0c31828ca22b1d7ff559eb71db72) cibmon[29356]: 2007/09/19_18:28:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.53.1 cibmon[29356]: 2007/09/19_18:28:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.53.2 cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.53.2 cibmon[29356]: 2007/09/19_18:28:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.54.1 cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:58 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:28:58 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=13:25:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cib[31012]: 2007/09/19_18:28:58 info: write_cib_contents: Wrote version 0.54.1 of the CIB to disk (digest: 85edb331fe3e84fb6bd79f4eb35e8ed7) cibmon[29356]: 2007/09/19_18:28:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.54.1 cibmon[29356]: 2007/09/19_18:28:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.54.2 cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:28:59 info: log_cib_diff: cib_apply_diff: Diff: --- 0.54.2 cibmon[29356]: 2007/09/19_18:28:59 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.55.1 cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:28:59 info: log_data_element: cib_apply_diff: + cib[31068]: 2007/09/19_18:28:59 info: write_cib_contents: Wrote version 0.55.1 of the CIB to disk (digest: 4bff50cc781c9d2c487626162497ca68) cibmon[29356]: 2007/09/19_18:29:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:00 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.56.1 cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:00 info: log_data_element: cib_apply_diff: + cib[31079]: 2007/09/19_18:29:00 info: write_cib_contents: Wrote version 0.56.1 of the CIB to disk (digest: e0297804eb5b1d20ec5cda8c738f56f0) mysql[31013][31083]: 2007/09/19_18:29:02 INFO: MySQL started crmd[29362]: 2007/09/19_18:29:02 info: process_lrm_event: LRM operation mysql_start_0 (call=41, rc=0) complete crmd[29362]: 2007/09/19_18:29:02 info: build_operation_update: Digest for 0:0;13:25:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[29362]: 2007/09/19_18:29:02 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:29:04 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=14:26:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:29:04 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=17:26:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:29:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.1 cibmon[29356]: 2007/09/19_18:29:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.2 cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:04 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:29:04 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=42, rc=0) complete msg[31093][31121]: 2007/09/19_18:29:05 INFO Completed switching to this node. msg[31093][31122]: 2007/09/19_18:29:05 INFO Node: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:29:05 info: process_lrm_event: LRM operation msg_last_start_0 (call=43, rc=0) complete crmd[29362]: 2007/09/19_18:29:05 info: build_operation_update: Digest for 0:0;17:26:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[29362]: 2007/09/19_18:29:05 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:29:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.2 cibmon[29356]: 2007/09/19_18:29:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.3 cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.3 cibmon[29356]: 2007/09/19_18:29:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.4 cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:05 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:29:06 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=18:26:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:29:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.4 cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.5 cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.5 cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.6 cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.6 cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.7 cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.7 cibmon[29356]: 2007/09/19_18:29:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.8 cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:06 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:29:06 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=44, rc=0) complete cibmon[29356]: 2007/09/19_18:29:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:29:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.8 cibmon[29356]: 2007/09/19_18:29:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.56.9 cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:29:08 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:33:20 info: cib_stats: Processed 323 operations (804.00us average, 0% utilization) in the last 10min cibmon[29356]: 2007/09/19_18:34:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:34:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.56.9 cibmon[29356]: 2007/09/19_18:34:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.57.1 cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:34:57 info: log_data_element: cib_apply_diff: + cib[31343]: 2007/09/19_18:34:57 info: write_cib_contents: Wrote version 0.57.1 of the CIB to disk (digest: 0f9aa4b2792254977964766096166fc5) cibmon[29356]: 2007/09/19_18:36:41 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:41 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.58.1 cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:41 info: log_data_element: cib_apply_diff: + cib[31434]: 2007/09/19_18:36:41 info: write_cib_contents: Wrote version 0.58.1 of the CIB to disk (digest: 8a63cde3672a862f05ade69c730dc571) cibmon[29356]: 2007/09/19_18:36:42 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:42 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.59.1 cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:42 info: log_data_element: cib_apply_diff: + cib[31438]: 2007/09/19_18:36:42 info: write_cib_contents: Wrote version 0.59.1 of the CIB to disk (digest: c6907efefb3efc847dce4a0206aa8101) cibmon[29356]: 2007/09/19_18:36:43 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:43 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.60.1 cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:43 info: log_data_element: cib_apply_diff: + cib[31440]: 2007/09/19_18:36:44 info: write_cib_contents: Wrote version 0.60.1 of the CIB to disk (digest: 8f0a02a0046336cdb272e47122bb7e1d) cibmon[29356]: 2007/09/19_18:36:44 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:44 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.61.1 cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:44 info: log_data_element: cib_apply_diff: + cib[31442]: 2007/09/19_18:36:44 info: write_cib_contents: Wrote version 0.61.1 of the CIB to disk (digest: 9210ffa30d87d52ee28a18e96c0c49d4) cibmon[29356]: 2007/09/19_18:36:45 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:45 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.62.1 cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:45 info: log_data_element: cib_apply_diff: + cib[31443]: 2007/09/19_18:36:45 info: write_cib_contents: Wrote version 0.62.1 of the CIB to disk (digest: a2eec89f16d0288c049dc5e40a910934) cibmon[29356]: 2007/09/19_18:36:46 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:46 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.63.1 cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:46 info: log_data_element: cib_apply_diff: + cib[31447]: 2007/09/19_18:36:46 info: write_cib_contents: Wrote version 0.63.1 of the CIB to disk (digest: ec2988bbec15d89fc88b576e924551fe) cibmon[29356]: 2007/09/19_18:36:47 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:36:47 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.64.1 cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:36:47 info: log_data_element: cib_apply_diff: + cib[31449]: 2007/09/19_18:36:47 info: write_cib_contents: Wrote version 0.64.1 of the CIB to disk (digest: fb4d24e69ae621adf13fa7d3855668b2) crmd[29362]: 2007/09/19_18:39:52 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=12:35:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:39:52 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=16:35:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:39:52 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=39, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:39:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:52 info: log_cib_diff: cib_apply_diff: Local-only Change: 0.65.1 cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.65.1 cibmon[29356]: 2007/09/19_18:39:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.65.2 cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:52 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.65.2 cibmon[29356]: 2007/09/19_18:39:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.65.3 cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:53 info: log_data_element: cib_apply_diff: + cib[31736]: 2007/09/19_18:39:53 info: write_cib_contents: Wrote version 0.65.3 of the CIB to disk (digest: 6dae3a7f0b3226628f2e41c6f3bd56a2) daemontools[31724][31759]: 2007/09/19_18:39:53 INFO Starting vmstat-mon crmd[29362]: 2007/09/19_18:39:53 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=46, rc=0) complete crmd[29362]: 2007/09/19_18:39:53 info: build_operation_update: Digest for 0:0;16:35:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[29362]: 2007/09/19_18:39:53 info: log_data_element: build_operation_update: digest:source Filesystem[31723][31773]: 2007/09/19_18:39:53 INFO: Running stop for /dev/drbd0 on /share Filesystem[31723][31783]: 2007/09/19_18:39:53 INFO: Trying to unmount /share Filesystem[31723][31785]: 2007/09/19_18:39:53 INFO: unmounted /share successfully crmd[29362]: 2007/09/19_18:39:53 info: process_lrm_event: LRM operation share-FS_stop_0 (call=45, rc=0) complete cibmon[29356]: 2007/09/19_18:39:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.65.3 cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.65.4 cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.65.4 cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.66.1 cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.66.1 cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.66.2 cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cib[31793]: 2007/09/19_18:39:54 info: write_cib_contents: Wrote version 0.66.2 of the CIB to disk (digest: 39e464867a081dbc33354503768eb510) crmd[29362]: 2007/09/19_18:39:54 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=13:36:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:39:54 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=20:36:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:39:54 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=44, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:39:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.66.2 cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.66.3 cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.66.3 cibmon[29356]: 2007/09/19_18:39:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.1 cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:54 info: log_data_element: cib_apply_diff: + cib[31796]: 2007/09/19_18:39:55 info: write_cib_contents: Wrote version 0.67.1 of the CIB to disk (digest: 8739a6607f1fc84cdb22084b291de55c) crmd[29362]: 2007/09/19_18:39:55 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=47, rc=0) complete msg[31795][31826]: 2007/09/19_18:39:55 INFO Starting to switch away from this node. msg[31795][31827]: 2007/09/19_18:39:55 INFO Node: host-1.awale.qc.ca cibmon[29356]: 2007/09/19_18:39:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.1 cibmon[29356]: 2007/09/19_18:39:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.2 cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:55 info: process_lrm_event: LRM operation msg_last_stop_0 (call=48, rc=0) complete cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:55 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.2 cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.3 cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.3 cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.4 cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:56 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=12:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:39:56 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=15:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:39:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.4 cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.5 cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:56 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=47, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:56 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=42, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.5 cibmon[29356]: 2007/09/19_18:39:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.6 cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:56 info: log_data_element: cib_apply_diff: + daemontools[31837][31859]: 2007/09/19_18:39:57 INFO Stoping vmstat-mon crmd[29362]: 2007/09/19_18:39:57 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=49, rc=0) complete crmd[29362]: 2007/09/19_18:39:57 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=10:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:39:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.6 cibmon[29356]: 2007/09/19_18:39:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.7 cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.7 cibmon[29356]: 2007/09/19_18:39:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.8 cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:57 info: log_data_element: cib_apply_diff: + Filesystem[31862][31891]: 2007/09/19_18:39:57 INFO: Running start for /dev/drbd0 on /share crmd[29362]: 2007/09/19_18:39:57 info: process_lrm_event: LRM operation share-FS_start_0 (call=51, rc=0) complete crmd[29362]: 2007/09/19_18:39:57 info: build_operation_update: Digest for 0:0;10:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:39:57 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.8 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.9 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.9 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.10 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.10 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.11 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.11 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.12 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.12 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.13 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:58 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=11:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:39:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.13 cibmon[29356]: 2007/09/19_18:39:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.14 cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:39:58 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:39:59 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=52, rc=0) complete cibmon[29356]: 2007/09/19_18:40:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.14 cibmon[29356]: 2007/09/19_18:40:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.15 cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:00 info: log_data_element: cib_apply_diff: + mysql[31838][31948]: 2007/09/19_18:40:01 INFO: MySQL stopped crmd[29362]: 2007/09/19_18:40:01 info: process_lrm_event: LRM operation mysql_stop_0 (call=50, rc=0) complete crmd[29362]: 2007/09/19_18:40:02 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=19:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:40:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.15 cibmon[29356]: 2007/09/19_18:40:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.16 cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.16 cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.17 cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.17 cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.18 cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + msg[31951][31972]: 2007/09/19_18:40:03 INFO Starting to switch to this node. msg[31951][31973]: 2007/09/19_18:40:03 INFO Node: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:40:03 info: process_lrm_event: LRM operation msg_first_start_0 (call=53, rc=0) complete crmd[29362]: 2007/09/19_18:40:03 info: build_operation_update: Digest for 0:0;19:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[29362]: 2007/09/19_18:40:03 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:40:03 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=20:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:40:03 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=24:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:40:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.18 cibmon[29356]: 2007/09/19_18:40:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.19 cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:03 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:40:04 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=54, rc=0) complete IPaddr[31984][32029]: 2007/09/19_18:40:04 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[31984][32034]: 2007/09/19_18:40:04 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[31984][32056]: 2007/09/19_18:40:04 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[29362]: 2007/09/19_18:40:04 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=55, rc=0) complete crmd[29362]: 2007/09/19_18:40:04 info: build_operation_update: Digest for 0:0;24:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[29362]: 2007/09/19_18:40:04 info: log_data_element: build_operation_update: digest:source cibmon[29356]: 2007/09/19_18:40:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.19 cibmon[29356]: 2007/09/19_18:40:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.20 cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:40:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=25:37:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:40:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.20 cibmon[29356]: 2007/09/19_18:40:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.21 cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:05 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:40:05 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=56, rc=0) complete cibmon[29356]: 2007/09/19_18:40:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.21 cibmon[29356]: 2007/09/19_18:40:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.22 cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:07 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.22 cibmon[29356]: 2007/09/19_18:40:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.23 cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:08 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.23 cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.24 cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.24 cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.25 cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.25 cibmon[29356]: 2007/09/19_18:40:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.26 cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:40:09 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:41:59 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=52, rc=7) complete crmd[29362]: 2007/09/19_18:42:00 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=4:39:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:42:00 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=52, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:42:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.26 cibmon[29356]: 2007/09/19_18:42:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.27 cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.27 cibmon[29356]: 2007/09/19_18:42:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.28 cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:00 info: log_data_element: cib_apply_diff: + Filesystem[32454][32483]: 2007/09/19_18:42:01 INFO: Running stop for /dev/drbd0 on /share crmd[29362]: 2007/09/19_18:42:01 info: process_lrm_event: LRM operation share-FS_stop_0 (call=57, rc=0) complete crmd[29362]: 2007/09/19_18:42:02 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=12:39:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:42:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.28 cibmon[29356]: 2007/09/19_18:42:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.29 cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.29 cibmon[29356]: 2007/09/19_18:42:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.30 cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:02 info: log_data_element: cib_apply_diff: + Filesystem[32492][32521]: 2007/09/19_18:42:02 INFO: Running start for /dev/drbd0 on /share crmd[29362]: 2007/09/19_18:42:02 info: process_lrm_event: LRM operation share-FS_start_0 (call=58, rc=0) complete crmd[29362]: 2007/09/19_18:42:02 info: build_operation_update: Digest for 0:0;12:39:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[29362]: 2007/09/19_18:42:02 info: log_data_element: build_operation_update: digest:source crmd[29362]: 2007/09/19_18:42:03 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=3:39:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:42:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.30 cibmon[29356]: 2007/09/19_18:42:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.31 cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:03 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:42:04 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=59, rc=0) complete cibmon[29356]: 2007/09/19_18:42:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:42:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.31 cibmon[29356]: 2007/09/19_18:42:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.32 cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:42:05 info: log_data_element: cib_apply_diff: + cib[29358]: 2007/09/19_18:43:20 info: cib_stats: Processed 205 operations (243.00us average, 0% utilization) in the last 10min heartbeat[543]: 2007/09/19_18:44:05 info: No log entry found in ha.cf -- use logd heartbeat[543]: 2007/09/19_18:44:05 info: Enabling logging daemon heartbeat[29345]: 2007/09/19_18:44:05 info: Configuration unchanged. heartbeat[543]: 2007/09/19_18:44:05 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[543]: 2007/09/19_18:44:05 info: Signalling heartbeat pid 29345 to reread config files heartbeat[29345]: 2007/09/19_18:44:15 info: killing /usr/lib/heartbeat/mgmtd -v process group 29363 with signal 15 mgmtd[29363]: 2007/09/19_18:44:15 info: mgmtd is shutting down heartbeat[29345]: 2007/09/19_18:44:15 info: killing /usr/lib/heartbeat/crmd process group 29362 with signal 15 crmd[29362]: 2007/09/19_18:44:15 info: crm_shutdown: Requesting shutdown crmd[29362]: 2007/09/19_18:44:15 info: do_shutdown_req: Sending shutdown request to DC: host-2.awale.qc.ca crmd[29362]: 2007/09/19_18:44:16 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=11:40:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:44:16 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=21:40:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[29356]: 2007/09/19_18:44:16 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:16 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.32 cibmon[29356]: 2007/09/19_18:44:16 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.33 cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:16 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:16 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=59, rc=-2) Cancelled crmd[29362]: 2007/09/19_18:44:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=56, rc=-2) Cancelled lrmd[29359]: 2007/09/19_18:44:16 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[29359]: 2007/09/19_18:44:16 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[588][622]: 2007/09/19_18:44:16 INFO: ifconfig eth0:0 down crmd[29362]: 2007/09/19_18:44:16 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=61, rc=0) complete Filesystem[587][634]: 2007/09/19_18:44:16 INFO: Running stop for /dev/drbd0 on /share Filesystem[587][644]: 2007/09/19_18:44:16 INFO: Trying to unmount /share Filesystem[587][646]: 2007/09/19_18:44:16 INFO: unmounted /share successfully crmd[29362]: 2007/09/19_18:44:16 info: process_lrm_event: LRM operation share-FS_stop_0 (call=60, rc=0) complete crmd[29362]: 2007/09/19_18:44:17 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=16:40:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[29362]: 2007/09/19_18:44:17 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=54, rc=-2) Cancelled cibmon[29356]: 2007/09/19_18:44:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.33 cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.34 cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.34 cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.35 cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.35 cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.36 cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.36 cibmon[29356]: 2007/09/19_18:44:17 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.37 cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:17 info: log_data_element: cib_apply_diff: + msg[652][673]: 2007/09/19_18:44:18 INFO Completed switching away from this node. msg[652][674]: 2007/09/19_18:44:18 INFO Node: host-1.awale.qc.ca crmd[29362]: 2007/09/19_18:44:18 info: process_lrm_event: LRM operation msg_first_stop_0 (call=62, rc=0) complete cibmon[29356]: 2007/09/19_18:44:18 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:18 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.37 cibmon[29356]: 2007/09/19_18:44:18 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.38 cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:18 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: do_state_transition: State transition S_NOT_DC -> S_STOPPING [ input=I_STOP cause=C_HA_MESSAGE origin=route_message ] crmd[29362]: 2007/09/19_18:44:19 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[29362]: 2007/09/19_18:44:19 info: verify_stopped: Checking for active resources before exit crmd[29362]: 2007/09/19_18:44:19 ERROR: verify_stopped: Resource share-drbd was active at shutdown. You may ignore this error if it is unmanaged. cibmon[29356]: 2007/09/19_18:44:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[29356]: 2007/09/19_18:44:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.38 cibmon[29356]: 2007/09/19_18:44:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.39 cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed ccm[29357]: 2007/09/19_18:44:19 info: client (pid=29362) removed from ccm crmd[29362]: 2007/09/19_18:44:19 info: verify_stopped: Checking for active resources before exit cibmon[29356]: 2007/09/19_18:44:19 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.39 cibmon[29356]: 2007/09/19_18:44:19 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.40 cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: - crmd[29362]: 2007/09/19_18:44:19 ERROR: verify_stopped: Resource share-drbd was active at shutdown. You may ignore this error if it is unmanaged. cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: do_lrm_control: Disconnected from the LRM cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: do_ha_control: Disconnected from Heartbeat cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: do_cib_control: Disconnecting CIB cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: crmd_cib_connection_destroy: Connection to the CIB terminated... cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd cibmon[29356]: 2007/09/19_18:44:19 info: log_data_element: cib_apply_diff: + crmd[29362]: 2007/09/19_18:44:19 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[29362]: 2007/09/19_18:44:19 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[29362]: 2007/09/19_18:44:19 info: do_exit: [crmd] stopped (0) cib[29358]: 2007/09/19_18:44:19 WARN: send_via_callback_channel: Cannot find client for token 6bc5e9b0-de6d-4d15-bc6d-139f560bfdd0 cib[29358]: 2007/09/19_18:44:19 WARN: do_local_notify: A-Sync reply to 29362 failed: client left before we could send reply heartbeat[29345]: 2007/09/19_18:44:19 info: killing /usr/lib/heartbeat/attrd process group 29361 with signal 15 attrd[29361]: 2007/09/19_18:44:19 info: attrd_shutdown: Exiting attrd[29361]: 2007/09/19_18:44:19 info: main: Exiting... heartbeat[29345]: 2007/09/19_18:44:19 info: killing /usr/lib/heartbeat/stonithd process group 29360 with signal 15 stonithd[29360]: 2007/09/19_18:44:19 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[29345]: 2007/09/19_18:44:19 info: killing /usr/lib/heartbeat/lrmd -r process group 29359 with signal 15 lrmd[29359]: 2007/09/19_18:44:19 info: lrmd is shutting down heartbeat[29345]: 2007/09/19_18:44:19 info: killing /usr/lib/heartbeat/cib process group 29358 with signal 15 cibmon[29356]: 2007/09/19_18:44:19 ERROR: cib_native_msgready: Message pending on command channel [29358] cib[29358]: 2007/09/19_18:44:19 WARN: disconnect_cib_client: Disconnecting /cib_ro... cibmon[29356]: 2007/09/19_18:44:19 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[29358]: 2007/09/19_18:44:19 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[29356]: 2007/09/19_18:44:19 ERROR: MSG: No message to dump cib[29358]: 2007/09/19_18:44:19 info: cib_shutdown: Disconnected 2 clients cibmon[29356]: 2007/09/19_18:44:19 info: cib_native_msgready: Lost connection to the CIB service [29358]. cib[29358]: 2007/09/19_18:44:19 info: cib_process_disconnect: All clients disconnected... cibmon[29356]: 2007/09/19_18:44:19 CRIT: cib_native_dispatch: Lost connection to the CIB service [29358/callback]. cib[29358]: 2007/09/19_18:44:19 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[29356]: 2007/09/19_18:44:19 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[29358]: 2007/09/19_18:44:20 info: cib_process_shutdown_req: Shutdown ACK from host-2.awale.qc.ca cib[29358]: 2007/09/19_18:44:20 info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat cib[29358]: 2007/09/19_18:44:21 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[29358]: 2007/09/19_18:44:21 info: main: Done heartbeat[29345]: 2007/09/19_18:44:21 info: killing /usr/lib/heartbeat/ccm process group 29357 with signal 15 ccm[29357]: 2007/09/19_18:44:21 info: client (pid=29358) removed from ccm ccm[29357]: 2007/09/19_18:44:21 info: received SIGTERM, going to shut down heartbeat[29345]: 2007/09/19_18:44:21 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[29345]: 2007/09/19_18:44:22 info: killing HBFIFO process 29349 with signal 15 heartbeat[29345]: 2007/09/19_18:44:22 info: killing HBWRITE process 29350 with signal 15 heartbeat[29345]: 2007/09/19_18:44:22 info: killing HBREAD process 29351 with signal 15 heartbeat[29345]: 2007/09/19_18:44:22 info: killing HBWRITE process 29352 with signal 15 heartbeat[29345]: 2007/09/19_18:44:22 info: killing HBREAD process 29353 with signal 15 heartbeat[29345]: 2007/09/19_18:44:22 info: Core process 29349 exited. 5 remaining heartbeat[29345]: 2007/09/19_18:44:22 info: Core process 29350 exited. 4 remaining heartbeat[29345]: 2007/09/19_18:44:22 info: Core process 29351 exited. 3 remaining heartbeat[29345]: 2007/09/19_18:44:22 info: Core process 29352 exited. 2 remaining heartbeat[29345]: 2007/09/19_18:44:22 info: Core process 29353 exited. 1 remaining heartbeat[29345]: 2007/09/19_18:44:22 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[29326]: 2007/09/19_18:44:23 info: logd_term_write_action: received SIGTERM logd[29326]: 2007/09/19_18:44:23 info: Exiting write process logd[706]: 2007/09/19_18:45:50 info: logd started with /etc/logd.cf. logd[710]: 2007/09/19_18:45:50 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[706]: 2007/09/19_18:45:50 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[727]: 2007/09/19_18:45:50 info: No log entry found in ha.cf -- use logd heartbeat[727]: 2007/09/19_18:45:50 info: Enabling logging daemon heartbeat[727]: 2007/09/19_18:45:50 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[727]: 2007/09/19_18:45:50 info: ************************** heartbeat[727]: 2007/09/19_18:45:50 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[728]: 2007/09/19_18:45:50 info: heartbeat: version 2.1.2 heartbeat[728]: 2007/09/19_18:45:50 info: Heartbeat generation: 1188360850 heartbeat[728]: 2007/09/19_18:45:50 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[728]: 2007/09/19_18:45:50 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[728]: 2007/09/19_18:45:50 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[728]: 2007/09/19_18:45:50 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[728]: 2007/09/19_18:45:50 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[728]: 2007/09/19_18:45:50 info: glib: ping group heartbeat started. heartbeat[728]: 2007/09/19_18:45:50 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[728]: 2007/09/19_18:45:50 info: Local status now set to: 'up' heartbeat[728]: 2007/09/19_18:45:52 info: Link local:local up. heartbeat[728]: 2007/09/19_18:45:52 info: Status update for node local: status ping heartbeat[728]: 2007/09/19_18:45:52 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[728]: 2007/09/19_18:45:52 info: Status update for node host-2.awale.qc.ca: status active heartbeat[728]: 2007/09/19_18:45:52 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[728]: 2007/09/19_18:45:52 info: Comm_now_up(): updating status to active heartbeat[728]: 2007/09/19_18:45:52 info: Local status now set to: 'active' heartbeat[728]: 2007/09/19_18:45:52 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[728]: 2007/09/19_18:45:52 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[739]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 739) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[728]: 2007/09/19_18:45:53 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[728]: 2007/09/19_18:45:53 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 80 ms (> 50 ms) (GSource: 0x8ce11e8) heartbeat[740]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 740) heartbeat[741]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 741) cibmon[739]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[742]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 742) heartbeat[745]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 745) heartbeat[746]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 746) heartbeat[744]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 744) heartbeat[743]: 2007/09/19_18:45:53 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 743) crmd[745]: 2007/09/19_18:45:53 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[745]: 2007/09/19_18:45:53 info: crmd_init: Starting crmd crmd[745]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[745]: 2007/09/19_18:45:53 info: G_main_add_TriggerHandler: Added signal manual handler crmd[745]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[742]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[742]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[742]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[742]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[742]: 2007/09/19_18:45:53 info: Started. cib[741]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[741]: 2007/09/19_18:45:53 info: G_main_add_TriggerHandler: Added signal manual handler cib[741]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[741]: 2007/09/19_18:45:53 info: main: Retrieval of a per-action CIB: disabled cib[741]: 2007/09/19_18:45:53 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml stonithd[743]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[743]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] mgmtd[746]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] mgmtd[746]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[746]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] ccm[740]: 2007/09/19_18:45:53 info: Hostname: host-1.awale.qc.ca cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] mgmtd[746]: 2007/09/19_18:45:53 info: init_crm mgmtd[746]: 2007/09/19_18:45:53 info: login to cib: 0, ret:-10 cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] stonithd[743]: 2007/09/19_18:45:53 info: Signing in with heartbeat. cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: log_data_element: readCibXmlFile: [on-disk] cib[741]: 2007/09/19_18:45:53 info: startCib: CIB Initialization completed successfully cib[741]: 2007/09/19_18:45:53 info: cib_register_ha: Signing in with Heartbeat stonithd[743]: 2007/09/19_18:45:53 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[743]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[741]: 2007/09/19_18:45:53 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[741]: 2007/09/19_18:45:53 WARN: cib_init: CCM Activation failed attrd[744]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[741]: 2007/09/19_18:45:53 WARN: cib_init: CCM Connection failed 1 times (30 max) ccm[740]: 2007/09/19_18:45:53 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[744]: 2007/09/19_18:45:53 info: register_with_ha: Hostname: host-1.awale.qc.ca attrd[744]: 2007/09/19_18:45:53 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[741]: 2007/09/19_18:45:54 info: cib_init: Starting cib mainloop cibmon[739]: 2007/09/19_18:45:54 info: main: Starting mainloop crmd[745]: 2007/09/19_18:45:54 info: do_cib_control: CIB connection established crmd[745]: 2007/09/19_18:45:54 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[741]: 2007/09/19_18:45:54 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[741]: 2007/09/19_18:45:54 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[741]: 2007/09/19_18:45:54 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[741]: 2007/09/19_18:45:54 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[741]: 2007/09/19_18:45:54 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[747]: 2007/09/19_18:45:54 info: write_cib_contents: Wrote version 0.67.1 of the CIB to disk (digest: 6ab03038187f1e0ee0cfa3cd12f6d02f) crmd[745]: 2007/09/19_18:45:54 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 cib[741]: 2007/09/19_18:45:54 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[745]: 2007/09/19_18:45:55 info: populate_cib_nodes: Requesting the list of configured nodes mgmtd[746]: 2007/09/19_18:45:55 info: Started. crmd[745]: 2007/09/19_18:45:56 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) cib[741]: 2007/09/19_18:45:56 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[741]: 2007/09/19_18:45:56 info: mem_handle_event: instance=10, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[741]: 2007/09/19_18:45:56 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cib[741]: 2007/09/19_18:45:56 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:45:56 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[745]: 2007/09/19_18:45:57 info: do_ha_control: Connected to Heartbeat crmd[745]: 2007/09/19_18:45:57 info: do_ccm_control: CCM connection established... waiting for first callback crmd[745]: 2007/09/19_18:45:57 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[745]: 2007/09/19_18:45:57 info: crmd_init: Starting crmd's mainloop crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[745]: 2007/09/19_18:45:57 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[745]: 2007/09/19_18:45:57 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[745]: 2007/09/19_18:45:57 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[745]: 2007/09/19_18:45:57 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cibmon[739]: 2007/09/19_18:45:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:45:57 info: log_cib_diff: cib_update: Local-only Change: 0.67.1 cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:45:57 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[745]: 2007/09/19_18:45:57 info: mem_handle_event: instance=10, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[745]: 2007/09/19_18:45:57 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=10) crmd[745]: 2007/09/19_18:45:57 info: ccm_event_detail: NEW MEMBERSHIP: trans=10, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 crmd[745]: 2007/09/19_18:45:57 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=4] crmd[745]: 2007/09/19_18:45:57 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=10] crmd[745]: 2007/09/19_18:45:57 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=4] crmd[745]: 2007/09/19_18:45:57 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=10] crmd[745]: 2007/09/19_18:45:57 info: do_started: The local CRM is operational crmd[745]: 2007/09/19_18:45:57 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[745]: 2007/09/19_18:45:57 info: update_dc: Set DC to () cibmon[739]: 2007/09/19_18:45:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:45:57 info: log_cib_diff: cib_update: Local-only Change: 0.67.1 cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:45:57 info: log_cib_diff: cib_update: Local-only Change: 0.67.1 cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:45:57 info: log_data_element: cib_update: + attrd[744]: 2007/09/19_18:45:59 info: main: Starting mainloop... crmd[745]: 2007/09/19_18:45:59 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:46:01 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:46:01 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[741]: 2007/09/19_18:46:01 info: cib_replace_notify: Replaced: 0.67.1 -> 0.67.43 from crmd[745]: 2007/09/19_18:46:01 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[739]: 2007/09/19_18:46:01 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_replace: Diff: --- 0.67.1 cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_replace: Diff: +++ 0.67.43 cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: - cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_replace: + cibmon[739]: 2007/09/19_18:46:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.43 cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.44 cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.44 cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.45 cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.45 cibmon[739]: 2007/09/19_18:46:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.46 cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:01 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:01 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[745]: 2007/09/19_18:46:02 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=9:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=10:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=11:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.46 crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=12:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.47 cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.47 cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.48 cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.48 cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.49 cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.49 cibmon[739]: 2007/09/19_18:46:02 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.50 cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:02 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=13:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=14:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=15:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=16:42:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:02 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=5, rc=7) complete crmd[745]: 2007/09/19_18:46:02 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2, rc=0) complete crmd[745]: 2007/09/19_18:46:02 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=3, rc=7) complete crmd[745]: 2007/09/19_18:46:02 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=4, rc=7) complete crmd[745]: 2007/09/19_18:46:03 info: process_lrm_event: LRM operation mysql_monitor_0 (call=6, rc=7) complete cibmon[739]: 2007/09/19_18:46:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.50 cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.51 cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.51 cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.52 cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.52 cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.53 cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.53 cibmon[739]: 2007/09/19_18:46:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.54 cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:03 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=8, rc=7) complete cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:03 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:03 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=7, rc=7) complete crmd[745]: 2007/09/19_18:46:03 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=9, rc=7) complete cibmon[739]: 2007/09/19_18:46:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.54 cibmon[739]: 2007/09/19_18:46:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.55 cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:04 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:05 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=10:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.55 cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.56 cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:05 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=13:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.56 cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.57 cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:05 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=23:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:05 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.57 cibmon[739]: 2007/09/19_18:46:05 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.58 cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:05 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:05 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=10, rc=0) complete Filesystem[858][915]: 2007/09/19_18:46:05 INFO: Running start for /dev/drbd0 on /share IPaddr[859][920]: 2007/09/19_18:46:05 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[859][929]: 2007/09/19_18:46:05 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 crmd[745]: 2007/09/19_18:46:05 info: process_lrm_event: LRM operation share-FS_start_0 (call=11, rc=0) complete crmd[745]: 2007/09/19_18:46:05 info: build_operation_update: Digest for 0:0;13:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[745]: 2007/09/19_18:46:05 info: log_data_element: build_operation_update: digest:source IPaddr[859][966]: 2007/09/19_18:46:06 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[745]: 2007/09/19_18:46:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=12, rc=0) complete crmd[745]: 2007/09/19_18:46:06 info: build_operation_update: Digest for 0:0;23:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[745]: 2007/09/19_18:46:06 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_18:46:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.58 cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.59 cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.59 cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.60 cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.60 cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.61 cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:07 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=11:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:07 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=15:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:07 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.61 cibmon[739]: 2007/09/19_18:46:07 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.62 cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:07 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:07 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=26:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) crmd[745]: 2007/09/19_18:46:07 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=13, rc=0) complete crmd[745]: 2007/09/19_18:46:07 info: build_operation_update: Digest for 0:0;11:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[745]: 2007/09/19_18:46:07 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:46:07 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=15, rc=0) complete crmd[745]: 2007/09/19_18:46:08 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=14, rc=0) complete crmd[745]: 2007/09/19_18:46:09 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=12:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:46:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.62 cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.63 cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.63 cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.64 cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.64 cibmon[739]: 2007/09/19_18:46:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.65 cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:09 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:46:09 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=16, rc=0) complete cibmon[739]: 2007/09/19_18:46:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:46:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.65 cibmon[739]: 2007/09/19_18:46:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.67.66 cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:46:11 info: log_data_element: cib_apply_diff: + cib[741]: 2007/09/19_18:47:00 ERROR: cib_process_request: cib_ismaster operation failed: Local service is not the master instance cib[741]: 2007/09/19_18:47:00 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_18:47:00 info: MSG: Dumping message with 7 fields cib[741]: 2007/09/19_18:47:00 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_18:47:00 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_18:47:00 info: MSG[2] : [cib_op=cib_ismaster] cib[741]: 2007/09/19_18:47:00 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_18:47:00 info: MSG[4] : [cib_callopt=256] cib[741]: 2007/09/19_18:47:00 info: MSG[5] : [cib_clientid=2c1f3322-bbc8-4f08-9cc7-7b82825c8c82] cib[741]: 2007/09/19_18:47:00 info: MSG[6] : [cib_clientname=1191] cib[741]: 2007/09/19_18:47:08 ERROR: cib_process_request: cib_ismaster operation failed: Local service is not the master instance cib[741]: 2007/09/19_18:47:08 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_18:47:08 info: MSG: Dumping message with 7 fields cib[741]: 2007/09/19_18:47:08 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_18:47:08 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_18:47:08 info: MSG[2] : [cib_op=cib_ismaster] cib[741]: 2007/09/19_18:47:08 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_18:47:08 info: MSG[4] : [cib_callopt=256] cib[741]: 2007/09/19_18:47:08 info: MSG[5] : [cib_clientid=734f65aa-2092-499d-989c-2cbba8034464] cib[741]: 2007/09/19_18:47:08 info: MSG[6] : [cib_clientname=1209] cibmon[739]: 2007/09/19_18:49:32 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:49:32 info: log_cib_diff: cib_apply_diff: Diff: --- 0.67.66 cibmon[739]: 2007/09/19_18:49:32 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.1 cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:49:32 info: log_data_element: cib_apply_diff: + cib[1664]: 2007/09/19_18:49:32 info: write_cib_contents: Wrote version 0.68.1 of the CIB to disk (digest: 5b2f38e8453ea2c671dc6c544b753257) heartbeat[1781]: 2007/09/19_18:50:02 info: No log entry found in ha.cf -- use logd heartbeat[1781]: 2007/09/19_18:50:02 info: Enabling logging daemon heartbeat[1781]: 2007/09/19_18:50:02 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[1781]: 2007/09/19_18:50:02 info: ************************** heartbeat[1781]: 2007/09/19_18:50:02 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[1781]: 2007/09/19_18:50:02 info: heartbeat: already running [pid 728]. cibmon[739]: 2007/09/19_18:50:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.1 cibmon[739]: 2007/09/19_18:50:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.2 cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:26 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:26 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.2 cibmon[739]: 2007/09/19_18:50:26 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.3 cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:26 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:50:27 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=19:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:50:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.3 cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.4 cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.4 cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.5 cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.5 cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.6 cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + daemontools[1897][1907]: 2007/09/19_18:50:27 INFO Starting vmstat-mon cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:27 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.6 cibmon[739]: 2007/09/19_18:50:27 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.7 cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:27 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:50:27 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=17, rc=0) complete crmd[745]: 2007/09/19_18:50:27 info: build_operation_update: Digest for 0:0;19:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[745]: 2007/09/19_18:50:27 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=20:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:50:28 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:28 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.7 cibmon[739]: 2007/09/19_18:50:28 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.8 cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:28 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:50:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=18, rc=0) complete cibmon[739]: 2007/09/19_18:50:29 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:29 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.8 cibmon[739]: 2007/09/19_18:50:29 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.9 cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:29 info: log_data_element: cib_apply_diff: + crmd[745]: 2007/09/19_18:50:31 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=25:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd) cibmon[739]: 2007/09/19_18:50:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.9 cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.10 cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.10 cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.11 cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.11 cibmon[739]: 2007/09/19_18:50:31 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.12 cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:31 info: log_data_element: cib_apply_diff: + msg[1925][1946]: 2007/09/19_18:50:31 INFO Starting to switch to this node. msg[1925][1947]: 2007/09/19_18:50:31 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:50:31 info: process_lrm_event: LRM operation msg_first_start_0 (call=19, rc=0) complete crmd[745]: 2007/09/19_18:50:31 info: build_operation_update: Digest for 0:0;25:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[745]: 2007/09/19_18:50:31 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:33 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] crmd[745]: 2007/09/19_18:50:33 info: crmd_client_status_callback: Got client status callback - our DC is dead crmd[745]: 2007/09/19_18:50:33 info: do_state_transition: State transition S_NOT_DC -> S_ELECTION [ input=I_ELECTION cause=C_CRMD_STATUS_CALLBACK origin=crmd_client_status_callback ] crmd[745]: 2007/09/19_18:50:33 info: update_dc: Set DC to () crmd[745]: 2007/09/19_18:50:33 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[745]: 2007/09/19_18:50:33 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:50:33 info: do_election_check: Still waiting on 1 non-votes (2 total) cib[741]: 2007/09/19_18:50:33 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:50:33 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[739]: 2007/09/19_18:50:33 info: log_cib_diff: cib_apply_diff: Diff: --- 0.68.12 cibmon[739]: 2007/09/19_18:50:33 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.68.13 cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: - cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cibmon[739]: 2007/09/19_18:50:33 info: log_data_element: cib_apply_diff: + cib[741]: 2007/09/19_18:50:34 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[745]: 2007/09/19_18:50:34 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm cib[741]: 2007/09/19_18:50:34 info: mem_handle_event: Got an event OC_EV_MS_NOT_PRIMARY from ccm crmd[745]: 2007/09/19_18:50:34 info: mem_handle_event: instance=10, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cib[741]: 2007/09/19_18:50:34 info: mem_handle_event: instance=10, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[745]: 2007/09/19_18:50:34 info: crmd_ccm_msg_callback: Quorum lost after event=NOT PRIMARY (id=10) heartbeat[728]: 2007/09/19_18:50:44 info: Link host-2.awale.qc.ca:eth0 dead. crmd[745]: 2007/09/19_18:50:44 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[741]: 2007/09/19_18:50:44 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[745]: 2007/09/19_18:50:44 info: mem_handle_event: no mbr_track info cib[741]: 2007/09/19_18:50:44 info: mem_handle_event: no mbr_track info crmd[745]: 2007/09/19_18:50:44 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[741]: 2007/09/19_18:50:44 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[745]: 2007/09/19_18:50:44 info: mem_handle_event: instance=11, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[741]: 2007/09/19_18:50:44 info: mem_handle_event: instance=11, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[745]: 2007/09/19_18:50:44 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=11) cib[741]: 2007/09/19_18:50:44 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[745]: 2007/09/19_18:50:44 info: ccm_event_detail: NEW MEMBERSHIP: trans=11, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cib[741]: 2007/09/19_18:50:44 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:50:44 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=11] ccm[740]: 2007/09/19_18:50:44 info: Break tie for 2 nodes cluster crmd[745]: 2007/09/19_18:50:44 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=4] crmd[745]: 2007/09/19_18:50:44 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[745]: 2007/09/19_18:50:44 info: start_subsystem: Starting sub-system "tengine" cibmon[739]: 2007/09/19_18:50:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[745]: 2007/09/19_18:50:44 info: start_subsystem: Starting sub-system "pengine" cib[741]: 2007/09/19_18:50:44 info: cib_process_readwrite: We are now in R/W mode tengine[2002]: 2007/09/19_18:50:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 cibmon[739]: 2007/09/19_18:50:44 info: log_cib_diff: cib_update: Local-only Change: 0.68.13 crmd[745]: 2007/09/19_18:50:44 info: do_dc_takeover: Taking over DC status for this partition tengine[2002]: 2007/09/19_18:50:44 info: G_main_add_TriggerHandler: Added signal manual handler cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:50:44 info: update_dc: Set DC to () cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:50:44 info: join_make_offer: Making join offers based on membership 11 cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:50:44 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:44 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:44 info: log_cib_diff: cib_update: Diff: --- 0.68.13 cibmon[739]: 2007/09/19_18:50:44 info: log_cib_diff: cib_update: Diff: +++ 0.68.14 cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:44 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:50:44 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[2002]: 2007/09/19_18:50:44 info: te_init: Registering TE UUID: 2974a93a-aeed-4483-8a7a-4557ddb8520f tengine[2002]: 2007/09/19_18:50:44 info: set_graph_functions: Setting custom graph functions tengine[2002]: 2007/09/19_18:50:44 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[2002]: 2007/09/19_18:50:44 info: te_init: Starting tengine pengine[2003]: 2007/09/19_18:50:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[2003]: 2007/09/19_18:50:44 info: pe_init: Starting pengine crmd[745]: 2007/09/19_18:50:44 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:50:45 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[745]: 2007/09/19_18:50:45 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[745]: 2007/09/19_18:50:45 info: update_attrd: Connecting to attrd... cib[741]: 2007/09/19_18:50:45 info: sync_our_cib: Syncing CIB to all peers attrd[744]: 2007/09/19_18:50:45 info: attrd_local_callback: Sending full refresh cibmon[739]: 2007/09/19_18:50:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: --- 0.68.14 cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: +++ 0.68.15 cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: --- 0.68.15 cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: +++ 0.68.16 cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:50:45 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:50:45 info: build_operation_update: Digest for 0:0;25:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[745]: 2007/09/19_18:50:45 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:45 info: build_operation_update: Digest for 0:0;19:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[745]: 2007/09/19_18:50:45 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:45 info: build_operation_update: Digest for 0:0;23:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[745]: 2007/09/19_18:50:45 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:45 info: build_operation_update: Digest for 0:0;13:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[745]: 2007/09/19_18:50:45 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:45 info: build_operation_update: Digest for 0:0;11:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[745]: 2007/09/19_18:50:45 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:50:45 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: --- 0.68.16 cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: +++ 0.68.17 tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action msg_first_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: update_abort_priority: 'DC Takeover' abort superceeded cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action msg_last_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action vmstat-mon_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action IPaddr_10_0_0_59_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action share-FS_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action mysql_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:45 info: process_graph_event: Action share-drbdlinks_monitor_0 initiated by a different transitioner cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:50:45 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:50:45 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_18:50:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:50:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:50:45 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_18:50:45 info: unpack_graph: Unpacked transition 0: 5 actions in 5 synapses pengine[2003]: 2007/09/19_18:50:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:50:45 info: send_rsc_command: Initiating action 16: mysql_start_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:50:45 info: send_rsc_command: Initiating action 20: msg_first_monitor_120000 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_18:50:45 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_18:50:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:50:45 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_18:50:45 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:50:45 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[2003]: 2007/09/19_18:50:45 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_18:50:45 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_18:50:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:50:45 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=16:0:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_18:50:45 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-58.bz2 crmd[745]: 2007/09/19_18:50:45 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=20:0:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_18:50:45 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=21, rc=0) complete cibmon[739]: 2007/09/19_18:50:45 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: --- 0.68.17 cibmon[739]: 2007/09/19_18:50:45 info: log_cib_diff: cib_update: Diff: +++ 0.68.18 cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:50:45 info: match_graph_event: Action msg_first_monitor_120000 (20) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:45 info: log_data_element: cib_update: + mysql[2006][2103]: 2007/09/19_18:50:49 INFO: MySQL started crmd[745]: 2007/09/19_18:50:49 info: process_lrm_event: LRM operation mysql_start_0 (call=20, rc=0) complete crmd[745]: 2007/09/19_18:50:49 info: build_operation_update: Digest for 0:0;16:0:2974a93a-aeed-4483-8a7a-4557ddb8520f (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[745]: 2007/09/19_18:50:49 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_18:50:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: --- 0.68.18 tengine[2002]: 2007/09/19_18:50:50 info: match_graph_event: Action mysql_start_0 (16) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: +++ 0.68.19 tengine[2002]: 2007/09/19_18:50:50 info: send_rsc_command: Initiating action 17: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:50:50 info: send_rsc_command: Initiating action 21: msg_last_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:50:50 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=17:0:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:50:50 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=21:0:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_18:50:50 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=22, rc=0) complete cibmon[739]: 2007/09/19_18:50:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: --- 0.68.19 cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: +++ 0.68.20 cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:50:50 info: match_graph_event: Action mysql_monitor_120000 (17) confirmed on host-1.awale.qc.ca msg[2115][2141]: 2007/09/19_18:50:50 INFO Completed switching to this node. msg[2115][2142]: 2007/09/19_18:50:50 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:50:50 info: process_lrm_event: LRM operation msg_last_start_0 (call=23, rc=0) complete crmd[745]: 2007/09/19_18:50:50 info: build_operation_update: Digest for 0:0;21:0:2974a93a-aeed-4483-8a7a-4557ddb8520f (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[745]: 2007/09/19_18:50:50 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_18:50:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: --- 0.68.20 tengine[2002]: 2007/09/19_18:50:50 info: match_graph_event: Action msg_last_start_0 (21) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: +++ 0.68.21 tengine[2002]: 2007/09/19_18:50:50 info: send_rsc_command: Initiating action 22: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:50:50 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=22:0:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:50:50 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=24, rc=0) complete cibmon[739]: 2007/09/19_18:50:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:50:50 info: match_graph_event: Action msg_last_monitor_120000 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: --- 0.68.21 crmd[745]: 2007/09/19_18:50:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:50:50 info: run_graph: Transition 0: (Complete=5, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_18:50:50 info: log_cib_diff: cib_update: Diff: +++ 0.68.22 tengine[2002]: 2007/09/19_18:50:50 info: notify_crmd: Transition 0 status: te_complete - cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:50:50 info: log_data_element: cib_update: + heartbeat[728]: 2007/09/19_18:51:04 WARN: node host-2.awale.qc.ca: is dead crmd[745]: 2007/09/19_18:51:04 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] cibmon[739]: 2007/09/19_18:51:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:51:04 info: log_cib_diff: cib_update: Local-only Change: 0.68.22 cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:51:04 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:51:04 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:51:04 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:51:04 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:51:04 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_18:51:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_18:51:04 info: unpack_graph: Unpacked transition 1: 0 actions in 0 synapses pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_18:51:04 info: run_graph: Transition 1: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_18:51:04 info: notify_crmd: Transition 1 status: te_complete - pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:51:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:51:04 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:51:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:51:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:51:04 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-59.bz2 crmd[745]: 2007/09/19_18:51:43 info: handle_request: Current ping state: S_IDLE crmd[745]: 2007/09/19_18:51:51 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:51:52 info: handle_request: Current ping state: S_IDLE crmd[745]: 2007/09/19_18:51:55 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:51:56 info: handle_request: Current ping state: S_IDLE cibmon[739]: 2007/09/19_18:55:30 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_18:55:30 info: log_cib_diff: cib_delete: Diff: --- 0.68.22 cibmon[739]: 2007/09/19_18:55:30 info: log_cib_diff: cib_delete: Diff: +++ 0.68.23 cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_18:55:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:55:30 info: log_cib_diff: cib_update: Diff: --- 0.68.23 cibmon[739]: 2007/09/19_18:55:30 info: log_cib_diff: cib_update: Diff: +++ 0.69.1 cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_18:55:30 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_18:55:30 info: log_data_element: cib:diff: + tengine[2002]: 2007/09/19_18:55:30 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[745]: 2007/09/19_18:55:30 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_18:55:30 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cib[3163]: 2007/09/19_18:55:30 info: write_cib_contents: Wrote version 0.69.1 of the CIB to disk (digest: c7a9e504a58de7f3249a62ff7f022f08) pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_18:55:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_18:55:31 info: unpack_graph: Unpacked transition 2: 0 actions in 0 synapses pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_18:55:31 info: run_graph: Transition 2: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_18:55:31 info: notify_crmd: Transition 2 status: te_complete - pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_18:55:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:55:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:55:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:55:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:55:31 info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-60.bz2 cib[741]: 2007/09/19_18:55:54 info: cib_stats: Processed 100 operations (5200.00us average, 0% utilization) in the last 10min heartbeat[728]: 2007/09/19_18:55:56 info: Heartbeat restart on node host-2.awale.qc.ca heartbeat[728]: 2007/09/19_18:55:56 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[728]: 2007/09/19_18:55:56 info: Status update for node host-2.awale.qc.ca: status init heartbeat[728]: 2007/09/19_18:55:56 info: Status update for node host-2.awale.qc.ca: status up heartbeat[728]: 2007/09/19_18:55:56 info: all clients are now paused crmd[745]: 2007/09/19_18:55:56 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] crmd[745]: 2007/09/19_18:55:56 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[728]: 2007/09/19_18:55:57 info: all clients are now resumed crmd[745]: 2007/09/19_18:55:57 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] heartbeat[728]: 2007/09/19_18:55:57 info: Status update for node host-2.awale.qc.ca: status active cibmon[739]: 2007/09/19_18:55:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:55:57 info: log_cib_diff: cib_update: Local-only Change: 0.69.1 cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:57 info: log_data_element: cib_update: + cib[741]: 2007/09/19_18:55:58 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[728]: 2007/09/19_18:55:59 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [11:13] crmd[745]: 2007/09/19_18:55:59 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] heartbeat[728]: 2007/09/19_18:55:59 info: No pkts missing from host-2.awale.qc.ca! cibmon[739]: 2007/09/19_18:55:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:55:59 info: log_cib_diff: cib_update: Local-only Change: 0.69.1 cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:55:59 info: log_data_element: cib_update: + heartbeat[728]: 2007/09/19_18:56:00 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [15:17] heartbeat[728]: 2007/09/19_18:56:00 info: No pkts missing from host-2.awale.qc.ca! cib[741]: 2007/09/19_18:56:01 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[745]: 2007/09/19_18:56:01 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[741]: 2007/09/19_18:56:01 info: mem_handle_event: no mbr_track info crmd[745]: 2007/09/19_18:56:01 info: mem_handle_event: no mbr_track info cib[741]: 2007/09/19_18:56:01 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[745]: 2007/09/19_18:56:01 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[741]: 2007/09/19_18:56:01 info: mem_handle_event: instance=12, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[745]: 2007/09/19_18:56:01 info: mem_handle_event: instance=12, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[741]: 2007/09/19_18:56:01 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:56:01 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=12) cib[741]: 2007/09/19_18:56:01 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca crmd[745]: 2007/09/19_18:56:01 info: ccm_event_detail: NEW MEMBERSHIP: trans=12, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 crmd[745]: 2007/09/19_18:56:01 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=10] crmd[745]: 2007/09/19_18:56:01 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=12] crmd[745]: 2007/09/19_18:56:01 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=12] cibmon[739]: 2007/09/19_18:56:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:01 info: log_cib_diff: cib_update: Local-only Change: 0.69.1 cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:01 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:56:03 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_18:56:03 info: update_dc: Set DC to () crmd[745]: 2007/09/19_18:56:03 info: join_make_offer: Making join offers based on membership 12 tengine[2002]: 2007/09/19_18:56:03 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[745]: 2007/09/19_18:56:03 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks crmd[745]: 2007/09/19_18:56:03 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:56:04 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[745]: 2007/09/19_18:56:04 info: do_state_transition: All 2 cluster nodes responded to the join offer. attrd[744]: 2007/09/19_18:56:04 info: attrd_local_callback: Sending full refresh cib[741]: 2007/09/19_18:56:04 info: sync_our_cib: Syncing CIB to all peers cibmon[739]: 2007/09/19_18:56:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: --- 0.69.1 cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: +++ 0.69.2 cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: --- 0.69.2 cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: +++ 0.69.3 cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: --- 0.69.3 cibmon[739]: 2007/09/19_18:56:04 info: log_cib_diff: cib_update: Diff: +++ 0.69.4 cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:04 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:56:05 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;25:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;21:0:2974a93a-aeed-4483-8a7a-4557ddb8520f (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;19:46:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;23:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;13:43:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;16:0:2974a93a-aeed-4483-8a7a-4557ddb8520f (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: build_operation_update: Digest for 0:0;11:44:393ef259-7cbb-4c3f-b4a4-c43e7fc0c9dd (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[745]: 2007/09/19_18:56:05 info: log_data_element: build_operation_update: digest:source crmd[745]: 2007/09/19_18:56:05 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: --- 0.69.4 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: +++ 0.69.5 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:56:05 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: --- 0.69.5 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: +++ 0.69.6 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:56:05 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[745]: 2007/09/19_18:56:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:56:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:56:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:56:05 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_18:56:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-2.awale.qc.ca): pengine[2003]: 2007/09/19_18:56:05 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-1.awale.qc.ca): pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Move resource share-drbdlinks (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[2003]: 2007/09/19_18:56:05 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_18:56:05 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[745]: 2007/09/19_18:56:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[2003]: 2007/09/19_18:56:05 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[2003]: 2007/09/19_18:56:05 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[2003]: 2007/09/19_18:56:05 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_18:56:05 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[2003]: 2007/09/19_18:56:05 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_18:56:05 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_18:56:05 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_18:56:05 info: unpack_graph: Unpacked transition 3: 22 actions in 22 synapses tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 11: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 12: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 22: share-drbdlinks_stop_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 13: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 14: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 27: vmstat-mon_stop_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 15: mysql_monitor_0 on host-2.awale.qc.ca crmd[745]: 2007/09/19_18:56:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=22:3:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 16: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 17: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:05 info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-61.bz2 tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 35: msg_last_stop_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:05 info: send_rsc_command: Initiating action 18: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca crmd[745]: 2007/09/19_18:56:05 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=27:3:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_18:56:05 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=35:3:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_18:56:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=16, rc=-2) Cancelled crmd[745]: 2007/09/19_18:56:05 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=18, rc=-2) Cancelled crmd[745]: 2007/09/19_18:56:05 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=24, rc=-2) Cancelled cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: --- 0.69.6 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: +++ 0.69.7 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: --- 0.69.7 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: +++ 0.69.8 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: --- 0.69.8 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_delete: Diff: +++ 0.69.9 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_delete: + daemontools[3279][3292]: 2007/09/19_18:56:05 INFO Stoping vmstat-mon crmd[745]: 2007/09/19_18:56:05 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=26, rc=0) complete cibmon[739]: 2007/09/19_18:56:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: --- 0.69.9 cibmon[739]: 2007/09/19_18:56:05 info: log_cib_diff: cib_update: Diff: +++ 0.69.10 cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:56:05 info: match_graph_event: Action vmstat-mon_stop_0 (27) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:05 info: log_data_element: cib_update: + lrmd[742]: 2007/09/19_18:56:06 info: RA output: (share-drbdlinks:stop:stderr) umount: /var/lib/mysql: device is busy lrmd[742]: 2007/09/19_18:56:06 info: RA output: (share-drbdlinks:stop:stderr) umount: /var/lib/mysql: device is busy lrmd[742]: 2007/09/19_18:56:06 info: RA output: (share-drbdlinks:stop:stderr) Error removing "/var/lib/mysql": [Errno 16] Device or resource busy: '/var/lib/mysql' lrmd[742]: 2007/09/19_18:56:06 info: RA output: (share-drbdlinks:stop:stderr) Error renaming "/var/lib/mysql.drbdlinks" to "/var/lib/mysql": [Errno 16] Device or resource busy crmd[745]: 2007/09/19_18:56:06 ERROR: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=25, rc=1) Error unknown error cibmon[739]: 2007/09/19_18:56:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:06 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 1): Error cibmon[739]: 2007/09/19_18:56:06 info: log_cib_diff: cib_update: Diff: --- 0.69.10 tengine[2002]: 2007/09/19_18:56:06 info: update_abort_priority: Abort priority upgraded to 1 cibmon[739]: 2007/09/19_18:56:06 info: log_cib_diff: cib_update: Diff: +++ 0.69.11 tengine[2002]: 2007/09/19_18:56:06 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:56:06 info: match_graph_event: Action share-drbdlinks_stop_0 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + msg[3280][3319]: 2007/09/19_18:56:06 INFO Starting to switch away from this node. msg[3280][3320]: 2007/09/19_18:56:06 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_18:56:06 info: process_lrm_event: LRM operation msg_last_stop_0 (call=27, rc=0) complete tengine[2002]: 2007/09/19_18:56:06 info: match_graph_event: Action msg_last_stop_0 (35) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:56:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:06 info: log_cib_diff: cib_update: Diff: --- 0.69.11 cibmon[739]: 2007/09/19_18:56:06 info: log_cib_diff: cib_update: Diff: +++ 0.69.12 cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: --- 0.69.12 cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: +++ 0.69.13 cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:07 info: match_graph_event: Action share-drbd_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:07 info: match_graph_event: Action vmstat-mon_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: --- 0.69.13 cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: +++ 0.69.14 cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: --- 0.69.14 cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: +++ 0.69.15 cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:56:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:07 info: match_graph_event: Action share-FS_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: --- 0.69.15 cibmon[739]: 2007/09/19_18:56:07 info: log_cib_diff: cib_update: Diff: +++ 0.69.16 cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:07 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: --- 0.69.16 cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: +++ 0.69.17 cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:56:08 info: match_graph_event: Action mysql_monitor_0 (15) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: --- 0.69.17 cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: +++ 0.69.18 cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:56:08 info: match_graph_event: Action msg_first_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: --- 0.69.18 cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: +++ 0.69.19 cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:56:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (18) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:56:08 info: match_graph_event: Action msg_last_monitor_0 (17) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:08 info: send_rsc_command: Initiating action 10: probe_complete on host-2.awale.qc.ca tengine[2002]: 2007/09/19_18:56:08 info: run_graph: ==================================================== crmd[745]: 2007/09/19_18:56:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:56:08 notice: run_graph: Transition 3: (Complete=12, Pending=0, Fired=0, Skipped=10, Incomplete=0) crmd[745]: 2007/09/19_18:56:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_18:56:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: --- 0.69.19 cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_update: Diff: +++ 0.69.20 cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_18:56:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:56:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:56:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:56:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:08 info: unpack_graph: Unpacked transition 4: 8 actions in 8 synapses pengine[2003]: 2007/09/19_18:56:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:08 info: send_rsc_command: Initiating action 15: vmstat-mon_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_18:56:08 info: send_rsc_command: Initiating action 17: mysql_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_18:56:08 info: send_rsc_command: Initiating action 7: probe_complete on host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_18:56:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[2003]: 2007/09/19_18:56:08 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_18:56:08 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=17:4:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_18:56:08 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_18:56:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:08 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-1.awale.qc.ca): pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_18:56:08 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_18:56:08 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[2003]: 2007/09/19_18:56:08 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[2003]: 2007/09/19_18:56:08 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_18:56:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_18:56:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_18:56:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:08 WARN: should_dump_action: action 12 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:56:08 WARN: should_dump_action: action 12 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) crmd[745]: 2007/09/19_18:56:08 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=22, rc=-2) Cancelled cibmon[739]: 2007/09/19_18:56:08 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed pengine[2003]: 2007/09/19_18:56:08 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-171.bz2 cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_delete: Diff: --- 0.69.20 pengine[2003]: 2007/09/19_18:56:08 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[739]: 2007/09/19_18:56:08 info: log_cib_diff: cib_delete: Diff: +++ 0.69.21 cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:56:08 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_18:56:10 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[2002]: 2007/09/19_18:56:10 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_modify: Diff: --- 0.69.21 tengine[2002]: 2007/09/19_18:56:10 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_modify: Diff: +++ 0.69.22 tengine[2002]: 2007/09/19_18:56:10 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_modify: Diff: --- 0.69.22 cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_modify: Diff: +++ 0.69.23 cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:56:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_update: Diff: --- 0.69.23 cibmon[739]: 2007/09/19_18:56:10 info: log_cib_diff: cib_update: Diff: +++ 0.69.24 cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_18:56:10 info: match_graph_event: Action vmstat-mon_start_0 (15) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:10 info: log_data_element: cib_update: + mysql[3330][3405]: 2007/09/19_18:56:12 INFO: MySQL stopped crmd[745]: 2007/09/19_18:56:12 info: process_lrm_event: LRM operation mysql_stop_0 (call=28, rc=0) complete cibmon[739]: 2007/09/19_18:56:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:12 info: match_graph_event: Action mysql_stop_0 (17) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:56:12 info: log_cib_diff: cib_update: Diff: --- 0.69.24 crmd[745]: 2007/09/19_18:56:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:56:12 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_18:56:12 info: log_cib_diff: cib_update: Diff: +++ 0.69.25 crmd[745]: 2007/09/19_18:56:12 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_18:56:12 notice: run_graph: Transition 4: (Complete=3, Pending=0, Fired=0, Skipped=5, Incomplete=0) cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:12 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_18:56:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_18:56:12 info: unpack_graph: Unpacked transition 5: 5 actions in 5 synapses pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_18:56:12 info: send_rsc_command: Initiating action 16: vmstat-mon_monitor_120000 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_18:56:12 info: send_rsc_command: Initiating action 17: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:56:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_18:56:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_18:56:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_18:56:12 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_18:56:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:56:12 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-1.awale.qc.ca): pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_18:56:12 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_18:56:12 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Leave resource vmstat-mon (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[2003]: 2007/09/19_18:56:12 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_18:56:12 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_18:56:12 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_18:56:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:56:12 WARN: should_dump_action: action 11 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:56:12 WARN: should_dump_action: action 11 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:56:12 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-172.bz2 pengine[2003]: 2007/09/19_18:56:12 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[739]: 2007/09/19_18:56:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:13 info: match_graph_event: Action vmstat-mon_monitor_120000 (16) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:13 info: log_cib_diff: cib_update: Diff: --- 0.69.25 cibmon[739]: 2007/09/19_18:56:13 info: log_cib_diff: cib_update: Diff: +++ 0.69.26 cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:17 info: match_graph_event: Action mysql_start_0 (17) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:17 info: log_cib_diff: cib_update: Diff: --- 0.69.26 tengine[2002]: 2007/09/19_18:56:17 info: send_rsc_command: Initiating action 18: mysql_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:17 info: log_cib_diff: cib_update: Diff: +++ 0.69.27 tengine[2002]: 2007/09/19_18:56:17 info: send_rsc_command: Initiating action 21: msg_last_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:56:19 info: log_cib_diff: cib_update: Diff: --- 0.69.27 cibmon[739]: 2007/09/19_18:56:19 info: log_cib_diff: cib_update: Diff: +++ 0.69.28 cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:56:19 info: match_graph_event: Action mysql_monitor_120000 (18) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:19 info: match_graph_event: Action msg_last_start_0 (21) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:19 info: log_cib_diff: cib_update: Diff: --- 0.69.28 tengine[2002]: 2007/09/19_18:56:19 info: send_rsc_command: Initiating action 22: msg_last_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:19 info: log_cib_diff: cib_update: Diff: +++ 0.69.29 cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:56:20 info: match_graph_event: Action msg_last_monitor_120000 (22) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_18:56:20 info: log_cib_diff: cib_update: Diff: --- 0.69.29 tengine[2002]: 2007/09/19_18:56:20 info: run_graph: Transition 5: (Complete=5, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_18:56:20 info: log_cib_diff: cib_update: Diff: +++ 0.69.30 tengine[2002]: 2007/09/19_18:56:20 info: notify_crmd: Transition 5 status: te_complete - cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:56:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:56:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:58:09 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=14, rc=7) complete cibmon[739]: 2007/09/19_18:58:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_update: Diff: --- 0.69.30 tengine[2002]: 2007/09/19_18:58:09 info: process_graph_event: Action share-FS_monitor_120000 initiated by a different transitioner cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_update: Diff: +++ 0.69.31 crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:58:09 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_18:58:09 WARN: update_failcount: Updating failcount for share-FS on 1da8804b-8a93-4145-9d40-1133699fe377 after failed monitor: rc=7 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:58:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:58:09 WARN: unpack_rsc_op: Processing failed op (share-FS_monitor_120000) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca FAILED pengine[2003]: 2007/09/19_18:58:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-1.awale.qc.ca): pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_18:58:09 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_18:58:09 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Recover resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[2003]: 2007/09/19_18:58:09 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_18:58:09 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource vmstat-mon (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource msg_last (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:58:09 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:58:09 WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-173.bz2 pengine[2003]: 2007/09/19_18:58:09 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_18:58:09 info: unpack_graph: Unpacked transition 6: 3 actions in 3 synapses tengine[2002]: 2007/09/19_18:58:09 info: send_rsc_command: Initiating action 5: share-FS_stop_0 on host-1.awale.qc.ca crmd[745]: 2007/09/19_18:58:09 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=5:6:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_18:58:09 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=14, rc=-2) Cancelled cibmon[739]: 2007/09/19_18:58:09 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_modify: Diff: --- 0.69.31 cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_modify: Diff: +++ 0.69.32 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_18:58:09 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_18:58:09 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_18:58:09 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_18:58:09 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_delete: Diff: --- 0.69.32 cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_delete: Diff: +++ 0.69.33 cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_delete: + Filesystem[3847][3876]: 2007/09/19_18:58:09 INFO: Running stop for /dev/drbd0 on /share crmd[745]: 2007/09/19_18:58:09 info: process_lrm_event: LRM operation share-FS_stop_0 (call=29, rc=0) complete cibmon[739]: 2007/09/19_18:58:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:58:09 info: match_graph_event: Action share-FS_stop_0 (5) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_update: Diff: --- 0.69.33 crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:58:09 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_18:58:09 info: log_cib_diff: cib_update: Diff: +++ 0.69.34 crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_18:58:09 notice: run_graph: Transition 6: (Complete=1, Pending=0, Fired=0, Skipped=2, Incomplete=0) cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:09 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_18:58:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_18:58:09 info: unpack_graph: Unpacked transition 7: 2 actions in 2 synapses pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_18:58:09 info: send_rsc_command: Initiating action 14: share-FS_start_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_18:58:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_18:58:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_18:58:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_18:58:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_18:58:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_18:58:09 info: native_assign_node: 2 nodes with equal score (100) for running the listed resources (chose host-1.awale.qc.ca): pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) crmd[745]: 2007/09/19_18:58:09 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=14:7:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_18:58:09 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_18:58:09 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_18:58:09 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_18:58:09 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource vmstat-mon (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource msg_last (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_18:58:09 WARN: should_dump_action: action 13 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:58:09 WARN: should_dump_action: action 13 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_18:58:09 WARN: process_pe_message: Transition 7: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-174.bz2 pengine[2003]: 2007/09/19_18:58:09 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. Filesystem[3885][3914]: 2007/09/19_18:58:10 INFO: Running start for /dev/drbd0 on /share crmd[745]: 2007/09/19_18:58:10 info: process_lrm_event: LRM operation share-FS_start_0 (call=30, rc=0) complete crmd[745]: 2007/09/19_18:58:10 info: build_operation_update: Digest for 0:0;14:7:2974a93a-aeed-4483-8a7a-4557ddb8520f (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[745]: 2007/09/19_18:58:10 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_18:58:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_18:58:10 info: match_graph_event: Action share-FS_start_0 (14) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:58:10 info: log_cib_diff: cib_update: Diff: --- 0.69.34 tengine[2002]: 2007/09/19_18:58:10 info: send_rsc_command: Initiating action 15: share-FS_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:58:10 info: log_cib_diff: cib_update: Diff: +++ 0.69.35 cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:58:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=15:7:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_18:58:10 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=31, rc=0) complete cibmon[739]: 2007/09/19_18:58:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_18:58:10 info: log_cib_diff: cib_update: Diff: --- 0.69.35 cibmon[739]: 2007/09/19_18:58:10 info: log_cib_diff: cib_update: Diff: +++ 0.69.36 tengine[2002]: 2007/09/19_18:58:10 info: match_graph_event: Action share-FS_monitor_120000 (15) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_18:58:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_18:58:10 info: run_graph: Transition 7: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_18:58:10 info: notify_crmd: Transition 7 status: te_complete - cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_18:58:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_delete: Diff: --- 0.69.36 cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_delete: Diff: +++ 0.69.37 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:00:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_update: Diff: --- 0.69.37 cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_update: Diff: +++ 0.70.1 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:00:20 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:00:20 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:00:20 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:00:20 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:00:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:00:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:00:20 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:00:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:00:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:00:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:00:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:00:20 info: unpack_graph: Unpacked transition 8: 6 actions in 6 synapses pengine[2003]: 2007/09/19_19:00:20 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:00:20 info: send_rsc_command: Initiating action 11: share-drbd_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:00:20 info: send_rsc_command: Initiating action 18: vmstat-mon_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Move resource share-drbd (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[2003]: 2007/09/19_19:00:20 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:00:20 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:20 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:20 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Move resource vmstat-mon (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: StopRsc: host-2.awale.qc.ca Stop vmstat-mon pengine[2003]: 2007/09/19_19:00:20 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[2003]: 2007/09/19_19:00:20 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Leave resource msg_last (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:20 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) crmd[745]: 2007/09/19_19:00:20 info: do_lrm_rsc_op: Performing op=share-drbd_stop_0 key=11:8:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:00:20 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:00:20 WARN: process_pe_message: Transition 8: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-175.bz2 pengine[2003]: 2007/09/19_19:00:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[4410]: 2007/09/19_19:00:20 info: write_cib_contents: Wrote version 0.70.1 of the CIB to disk (digest: dd59664989768a7147b70613e76b2864) crmd[745]: 2007/09/19_19:00:20 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=10, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:00:20 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_delete: Diff: --- 0.70.1 cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_delete: Diff: +++ 0.70.2 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) ioctl(,SET_STATE,) failed: cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) Device or resource busy cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) Someone has opened the device for RW access! cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) Command ' cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) /sbin/drbdsetup cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) /dev/drbd0 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) secondary cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) ' terminated with exit code 20 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: - crmd[745]: 2007/09/19_19:00:20 ERROR: process_lrm_event: LRM operation share-drbd_stop_0 (call=32, rc=20) Error lrmd[742]: 2007/09/19_19:00:20 info: RA output: (share-drbd:stop:stderr) drbdadm aborting cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:00:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_update: Diff: --- 0.70.2 cibmon[739]: 2007/09/19_19:00:20 info: log_cib_diff: cib_update: Diff: +++ 0.70.3 tengine[2002]: 2007/09/19_19:00:20 WARN: status_from_rc: Action stop on host-1.awale.qc.ca failed (target: vs. rc: 20): Error cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:00:20 info: update_abort_priority: Abort priority upgraded to 1 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:00:20 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:00:20 info: match_graph_event: Action share-drbd_stop_0 (11) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_delete: Diff: --- 0.70.3 cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_delete: Diff: +++ 0.70.4 cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_delete: + tengine[2002]: 2007/09/19_19:00:21 info: match_graph_event: Action vmstat-mon_stop_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:00:21 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:00:21 notice: run_graph: Transition 8: (Complete=2, Pending=0, Fired=0, Skipped=4, Incomplete=0) cibmon[739]: 2007/09/19_19:00:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[745]: 2007/09/19_19:00:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: --- 0.70.4 crmd[745]: 2007/09/19_19:00:21 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: +++ 0.70.5 cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:00:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:00:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:00:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:00:21 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:00:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:00:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:00:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped tengine[2002]: 2007/09/19_19:00:21 info: unpack_graph: Unpacked transition 9: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:00:21 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:00:21 info: send_rsc_command: Initiating action 15: vmstat-mon_start_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:00:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=15:9:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:00:21 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Recover resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:21 WARN: custom_action: Action share-drbd_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:21 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:21 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:00:21 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[2003]: 2007/09/19_19:00:21 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Leave resource msg_last (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:00:21 WARN: should_dump_action: action 10 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:00:21 WARN: should_dump_action: action 12 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:00:21 WARN: should_dump_action: action 10 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:00:21 WARN: should_dump_action: action 12 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:00:21 WARN: process_pe_message: Transition 9: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-176.bz2 pengine[2003]: 2007/09/19_19:00:21 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. daemontools[4413][4423]: 2007/09/19_19:00:21 INFO Starting vmstat-mon crmd[745]: 2007/09/19_19:00:21 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=33, rc=0) complete crmd[745]: 2007/09/19_19:00:21 info: build_operation_update: Digest for 0:0;15:9:2974a93a-aeed-4483-8a7a-4557ddb8520f (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[745]: 2007/09/19_19:00:21 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:00:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:00:21 info: match_graph_event: Action vmstat-mon_start_0 (15) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: --- 0.70.5 tengine[2002]: 2007/09/19_19:00:21 info: send_rsc_command: Initiating action 16: vmstat-mon_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: +++ 0.70.6 cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:00:21 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=16:9:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:00:21 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=34, rc=0) complete cibmon[739]: 2007/09/19_19:00:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: --- 0.70.6 cibmon[739]: 2007/09/19_19:00:21 info: log_cib_diff: cib_update: Diff: +++ 0.70.7 cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:00:21 info: match_graph_event: Action vmstat-mon_monitor_120000 (16) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:00:21 info: run_graph: Transition 9: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:00:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:00:21 info: notify_crmd: Transition 9 status: te_complete - cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:00:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:21 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:02:21 info: log_cib_diff: cib_delete: Diff: --- 0.70.7 cibmon[739]: 2007/09/19_19:02:21 info: log_cib_diff: cib_delete: Diff: +++ 0.70.8 cibmon[739]: 2007/09/19_19:02:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:21 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:02:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:02:21 info: log_cib_diff: cib_update: Diff: --- 0.70.8 cibmon[739]: 2007/09/19_19:02:21 info: log_cib_diff: cib_update: Diff: +++ 0.70.9 cibmon[739]: 2007/09/19_19:02:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: --- 0.70.9 cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: +++ 0.70.10 cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:02:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:02:59 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_update: Diff: --- 0.70.10 crmd[745]: 2007/09/19_19:02:59 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_update: Diff: +++ 0.71.1 crmd[745]: 2007/09/19_19:02:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:02:59 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:02:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:02:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:02:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:02:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:02:59 info: unpack_graph: Unpacked transition 10: 6 actions in 6 synapses pengine[2003]: 2007/09/19_19:02:59 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:02:59 info: send_rsc_command: Initiating action 14: share-FS_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:02:59 info: send_rsc_command: Initiating action 23: msg_last_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:02:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:02:59 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=14:10:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:02:59 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Recover resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:02:59 WARN: custom_action: Action share-drbd_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:02:59 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:02:59 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:02:59 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Move resource share-FS (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[2003]: 2007/09/19_19:02:59 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_19:02:59 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Move resource msg_last (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 notice: StopRsc: host-2.awale.qc.ca Stop msg_last pengine[2003]: 2007/09/19_19:02:59 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:02:59 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 cib[4970]: 2007/09/19_19:02:59 info: write_cib_contents: Wrote version 0.71.1 of the CIB to disk (digest: 6e00e570278841da0297c1f6ba0800c8) pengine[2003]: 2007/09/19_19:02:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:02:59 WARN: should_dump_action: action 11 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:02:59 WARN: should_dump_action: action 13 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:02:59 WARN: should_dump_action: action 11 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:02:59 WARN: should_dump_action: action 13 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:02:59 WARN: process_pe_message: Transition 10: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-177.bz2 pengine[2003]: 2007/09/19_19:02:59 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[745]: 2007/09/19_19:02:59 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=31, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:02:59 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: --- 0.71.1 cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: +++ 0.71.2 cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: + Filesystem[4971][5000]: 2007/09/19_19:02:59 INFO: Running stop for /dev/drbd0 on /share Filesystem[4971][5010]: 2007/09/19_19:02:59 INFO: Trying to unmount /share Filesystem[4971][5012]: 2007/09/19_19:02:59 INFO: unmounted /share successfully crmd[745]: 2007/09/19_19:02:59 info: process_lrm_event: LRM operation share-FS_stop_0 (call=35, rc=0) complete cibmon[739]: 2007/09/19_19:02:59 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_update: Diff: --- 0.71.2 cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_update: Diff: +++ 0.71.3 cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:02:59 info: match_graph_event: Action share-FS_stop_0 (14) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:02:59 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: --- 0.71.3 cibmon[739]: 2007/09/19_19:02:59 info: log_cib_diff: cib_delete: Diff: +++ 0.71.4 cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:02:59 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:03:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:03:00 info: match_graph_event: Action msg_last_stop_0 (23) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:03:00 info: log_cib_diff: cib_update: Diff: --- 0.71.4 crmd[745]: 2007/09/19_19:03:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:03:00 notice: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:03:00 info: log_cib_diff: cib_update: Diff: +++ 0.71.5 tengine[2002]: 2007/09/19_19:03:00 WARN: run_graph: Transition 10: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=4) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:03:00 ERROR: te_graph_trigger: Transition failed: terminated cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 0 was confirmed (priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 1 is pending (priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: [Action 15]: Pending (id: share-FS_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 11]: Pending (id: share-drbd_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 14]: Completed (id: share-FS_stop_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 2 is pending (priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: [Action 16]: Pending (id: share-FS_monitor_120000, loc: host-2.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 15]: Pending (id: share-FS_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 3 was confirmed (priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 4 is pending (priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: [Action 24]: Pending (id: msg_last_start_0, loc: host-1.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 11]: Pending (id: share-drbd_start_0, loc: host-2.awale.qc.ca, priority: 0) cibmon[739]: 2007/09/19_19:03:00 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 23]: Completed (id: msg_last_stop_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:03:00 WARN: print_graph: Synapse 5 is pending (priority: 0) tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: [Action 25]: Pending (id: msg_last_monitor_120000, loc: host-1.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:03:00 WARN: print_elem: * [Input 24]: Pending (id: msg_last_start_0, loc: host-1.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:03:00 info: notify_crmd: Transition 10 status: te_complete - cibmon[739]: 2007/09/19_19:03:07 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:03:07 info: log_cib_diff: cib_delete: Diff: --- 0.71.5 cibmon[739]: 2007/09/19_19:03:07 info: log_cib_diff: cib_delete: Diff: +++ 0.71.6 cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:03:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:03:07 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:03:07 info: log_cib_diff: cib_update: Diff: --- 0.71.6 crmd[745]: 2007/09/19_19:03:07 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:03:07 info: log_cib_diff: cib_update: Diff: +++ 0.72.1 crmd[745]: 2007/09/19_19:03:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:03:07 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:03:07 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:03:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:03:07 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:03:07 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:03:07 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:03:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:03:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:03:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:03:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:03:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:03:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:03:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:03:07 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:03:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:03:07 info: unpack_graph: Unpacked transition 11: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:03:07 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:03:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:03:07 notice: run_graph: ==================================================== pengine[2003]: 2007/09/19_19:03:07 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:03:07 WARN: run_graph: Transition 11: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=4) pengine[2003]: 2007/09/19_19:03:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:03:07 ERROR: te_graph_trigger: Transition failed: terminated pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Recover resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:03:07 WARN: print_graph: Synapse 0 is pending (priority: 0) pengine[2003]: 2007/09/19_19:03:07 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: [Action 12]: Pending (id: share-FS_start_0, loc: host-2.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 WARN: custom_action: Action share-drbd_start_0 (unmanaged) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_start_0, loc: host-2.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: StartRsc: host-2.awale.qc.ca Start share-drbd tengine[2002]: 2007/09/19_19:03:07 WARN: print_graph: Synapse 1 is pending (priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: [Action 13]: Pending (id: share-FS_monitor_120000, loc: host-2.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: * [Input 12]: Pending (id: share-FS_start_0, loc: host-2.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) tengine[2002]: 2007/09/19_19:03:07 WARN: print_graph: Synapse 2 is pending (priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: [Action 20]: Pending (id: msg_last_start_0, loc: host-1.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: StartRsc: host-2.awale.qc.ca Start share-FS tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: * [Input 9]: Pending (id: share-drbd_start_0, loc: host-2.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 tengine[2002]: 2007/09/19_19:03:07 WARN: print_graph: Synapse 3 is pending (priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: [Action 21]: Pending (id: msg_last_monitor_120000, loc: host-1.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:03:07 WARN: print_elem: * [Input 20]: Pending (id: msg_last_start_0, loc: host-1.awale.qc.ca, priority: 0) pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:03:07 info: notify_crmd: Transition 11 status: te_complete - pengine[2003]: 2007/09/19_19:03:07 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:03:07 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 cib[5034]: 2007/09/19_19:03:07 info: write_cib_contents: Wrote version 0.72.1 of the CIB to disk (digest: 49c917b41e42749106d48bcd953aa10e) pengine[2003]: 2007/09/19_19:03:07 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:03:07 WARN: should_dump_action: action 9 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:03:07 WARN: should_dump_action: action 11 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:03:07 WARN: should_dump_action: action 9 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:03:07 WARN: should_dump_action: action 11 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:03:07 WARN: process_pe_message: Transition 11: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-178.bz2 pengine[2003]: 2007/09/19_19:03:07 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[739]: 2007/09/19_19:03:35 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:03:35 info: log_cib_diff: cib_delete: Diff: --- 0.72.1 cibmon[739]: 2007/09/19_19:03:35 info: log_cib_diff: cib_delete: Diff: +++ 0.72.2 cibmon[739]: 2007/09/19_19:03:35 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:03:35 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:03:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:03:35 info: log_cib_diff: cib_update: Diff: --- 0.72.2 cibmon[739]: 2007/09/19_19:03:35 info: log_cib_diff: cib_update: Diff: +++ 0.72.3 cibmon[739]: 2007/09/19_19:03:35 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:03:35 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:03:40 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:03:40 info: log_cib_diff: cib_delete: Diff: --- 0.72.3 cibmon[739]: 2007/09/19_19:03:40 info: log_cib_diff: cib_delete: Diff: +++ 0.72.4 cibmon[739]: 2007/09/19_19:03:40 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:03:40 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:03:40 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:03:40 info: log_cib_diff: cib_update: Diff: --- 0.72.4 cibmon[739]: 2007/09/19_19:03:40 info: log_cib_diff: cib_update: Diff: +++ 0.72.5 cibmon[739]: 2007/09/19_19:03:40 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:03:40 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:05:54 info: cib_stats: Processed 85 operations (14352.00us average, 0% utilization) in the last 10min cibmon[739]: 2007/09/19_19:06:10 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[2002]: 2007/09/19_19:06:10 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[739]: 2007/09/19_19:06:10 info: log_cib_diff: cib_modify: Diff: --- 0.72.5 tengine[2002]: 2007/09/19_19:06:10 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:06:10 info: log_cib_diff: cib_modify: Diff: +++ 0.72.6 tengine[2002]: 2007/09/19_19:06:10 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:06:10 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:06:10 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_modify: + pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:06:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:06:10 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:06:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:06:10 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:06:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:06:10 info: unpack_graph: Unpacked transition 12: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:06:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 8: share-drbd_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 9: share-drbdlinks_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 10: share-FS_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 11: vmstat-mon_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 12: mysql_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=8:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 13: msg_first_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 14: msg_last_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) tengine[2002]: 2007/09/19_19:06:10 info: send_rsc_command: Initiating action 15: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Recover resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbd_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:06:10 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Recover resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:06:10 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) pengine[2003]: 2007/09/19_19:06:10 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:06:10 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_19:06:10 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:06:10 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=9:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:06:10 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:10 WARN: should_dump_action: action 17 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:06:10 WARN: should_dump_action: action 19 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[2003]: 2007/09/19_19:06:10 WARN: should_dump_action: action 17 (share-drbd_start_0) was for an unmanaged resource (share-drbd) pengine[2003]: 2007/09/19_19:06:10 WARN: should_dump_action: action 19 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=10:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=11:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:06:10 WARN: process_pe_message: Transition 12: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-179.bz2 pengine[2003]: 2007/09/19_19:06:10 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=12:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=13:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=14:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:06:10 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=15:12:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:06:10 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=36, rc=7) complete cibmon[739]: 2007/09/19_19:06:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:10 info: log_cib_diff: cib_update: Diff: --- 0.72.6 cibmon[739]: 2007/09/19_19:06:10 info: log_cib_diff: cib_update: Diff: +++ 0.72.7 cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:10 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:10 info: match_graph_event: Action share-drbd_monitor_0 (8) confirmed on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:06:11 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=39, rc=0) complete cibmon[739]: 2007/09/19_19:06:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: --- 0.72.7 cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: +++ 0.72.8 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:11 info: match_graph_event: Action vmstat-mon_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:11 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=37, rc=7) complete cibmon[739]: 2007/09/19_19:06:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: --- 0.72.8 cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: +++ 0.72.9 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:11 info: match_graph_event: Action share-drbdlinks_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_modify: Diff: --- 0.72.9 cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_modify: Diff: +++ 0.72.10 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:06:11 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:06:11 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:06:11 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:06:11 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_modify: + crmd[745]: 2007/09/19_19:06:11 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=38, rc=7) complete cibmon[739]: 2007/09/19_19:06:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:11 info: match_graph_event: Action share-FS_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: --- 0.72.10 cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: +++ 0.72.11 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:11 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=43, rc=0) complete cibmon[739]: 2007/09/19_19:06:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: --- 0.72.11 cibmon[739]: 2007/09/19_19:06:11 info: log_cib_diff: cib_update: Diff: +++ 0.72.12 cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:11 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (15) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:11 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:12 info: process_lrm_event: LRM operation mysql_monitor_0 (call=40, rc=7) complete cibmon[739]: 2007/09/19_19:06:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: --- 0.72.12 cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: +++ 0.72.13 cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:12 info: match_graph_event: Action mysql_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:12 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=41, rc=0) complete cibmon[739]: 2007/09/19_19:06:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: --- 0.72.13 cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: +++ 0.72.14 cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:12 info: match_graph_event: Action msg_first_monitor_0 (13) confirmed on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:06:12 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=42, rc=7) complete cibmon[739]: 2007/09/19_19:06:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: --- 0.72.14 cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_update: Diff: +++ 0.72.15 cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:12 info: match_graph_event: Action msg_last_monitor_0 (14) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 7: probe_complete on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:12 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:12 notice: run_graph: Transition 12: (Complete=9, Pending=0, Fired=0, Skipped=5, Incomplete=0) cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:06:12 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:06:12 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_modify: Diff: --- 0.72.15 cibmon[739]: 2007/09/19_19:06:12 info: log_cib_diff: cib_modify: Diff: +++ 0.72.16 cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:06:12 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:06:12 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:12 info: log_data_element: cib_modify: + pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:06:12 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 info: process_pe_message: Transition 13: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-62.bz2 pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:06:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:06:12 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:06:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 crmd[745]: 2007/09/19_19:06:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:12 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:06:12 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:06:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:06:12 info: unpack_graph: Unpacked transition 14: 18 actions in 18 synapses tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 7: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 8: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 9: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 11: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 12: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 13: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:12 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:12 info: process_pe_message: Transition 14: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-63.bz2 cibmon[739]: 2007/09/19_19:06:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: --- 0.72.16 cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: +++ 0.72.17 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:13 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: match_graph_event: Action mysql_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: --- 0.72.17 cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: +++ 0.72.18 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=0 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 WARN: status_from_rc: Action monitor on host-2.awale.qc.ca failed (target: 7 vs. rc: 0): Error cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: update_abort_priority: Abort priority upgraded to 1 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: match_graph_event: Action share-drbd_monitor_0 (7) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: --- 0.72.18 cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: +++ 0.72.19 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (8) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: --- 0.72.19 cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: +++ 0.72.20 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:13 info: match_graph_event: Action share-FS_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: --- 0.72.20 cibmon[739]: 2007/09/19_19:06:13 info: log_cib_diff: cib_update: Diff: +++ 0.72.21 cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:13 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: --- 0.72.21 cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: +++ 0.72.22 cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:14 info: match_graph_event: Action msg_last_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:14 info: match_graph_event: Action msg_first_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: --- 0.72.22 cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: +++ 0.72.23 cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:14 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:06:14 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:14 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:06:14 notice: run_graph: Transition 14: (Complete=8, Pending=0, Fired=0, Skipped=9, Incomplete=1) cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: --- 0.72.23 cibmon[739]: 2007/09/19_19:06:14 info: log_cib_diff: cib_update: Diff: +++ 0.72.24 cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:14 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:06:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:06:14 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:14 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:06:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:06:14 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:14 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:06:14 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:06:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:06:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:14 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:14 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[2003]: 2007/09/19_19:06:14 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:06:14 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[2003]: 2007/09/19_19:06:14 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[2003]: 2007/09/19_19:06:14 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_19:06:14 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:14 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:14 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:14 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:06:14 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:06:14 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:06:14 info: unpack_graph: Unpacked transition 15: 17 actions in 17 synapses pengine[2003]: 2007/09/19_19:06:14 info: process_pe_message: Transition 15: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-64.bz2 tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 7: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 18: share-drbd_monitor_120000 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 8: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 9: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 11: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 12: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 13: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:14 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:16 info: match_graph_event: Action share-drbd_monitor_0 (7) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: --- 0.72.24 cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: +++ 0.72.25 cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: --- 0.72.25 cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: +++ 0.72.26 cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:16 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: --- 0.72.26 cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: +++ 0.72.27 cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:16 info: match_graph_event: Action share-drbd_monitor_120000 (18) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: --- 0.72.27 cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: +++ 0.72.28 cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:16 info: match_graph_event: Action share-drbdlinks_monitor_0 (8) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: --- 0.72.28 tengine[2002]: 2007/09/19_19:06:16 info: match_graph_event: Action share-FS_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:16 info: log_cib_diff: cib_update: Diff: +++ 0.72.29 cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: --- 0.72.29 cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: +++ 0.72.30 cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:17 info: match_graph_event: Action mysql_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: --- 0.72.30 cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: +++ 0.72.31 cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:17 info: match_graph_event: Action msg_last_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: --- 0.72.31 cibmon[739]: 2007/09/19_19:06:17 info: log_cib_diff: cib_update: Diff: +++ 0.72.32 cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:17 info: match_graph_event: Action msg_first_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: --- 0.72.32 tengine[2002]: 2007/09/19_19:06:18 info: send_rsc_command: Initiating action 6: probe_complete on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: +++ 0.72.33 tengine[2002]: 2007/09/19_19:06:18 info: te_pseudo_action: Pseudo action 5 fired and confirmed cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:18 info: send_rsc_command: Initiating action 21: share-FS_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:06:18 info: send_rsc_command: Initiating action 29: msg_last_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:06:18 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=29:15:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + msg[5721][5742]: 2007/09/19_19:06:18 INFO Completed switching to this node. msg[5721][5743]: 2007/09/19_19:06:18 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:06:18 info: process_lrm_event: LRM operation msg_last_start_0 (call=44, rc=0) complete crmd[745]: 2007/09/19_19:06:18 info: build_operation_update: Digest for 0:0;29:15:2974a93a-aeed-4483-8a7a-4557ddb8520f (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[745]: 2007/09/19_19:06:18 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:06:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:18 info: match_graph_event: Action msg_last_start_0 (29) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: --- 0.72.33 tengine[2002]: 2007/09/19_19:06:18 info: send_rsc_command: Initiating action 30: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: +++ 0.72.34 cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:06:18 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=30:15:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:18 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=45, rc=0) complete cibmon[739]: 2007/09/19_19:06:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:18 info: match_graph_event: Action msg_last_monitor_120000 (30) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: --- 0.72.34 cibmon[739]: 2007/09/19_19:06:18 info: log_cib_diff: cib_update: Diff: +++ 0.72.35 cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[2002]: 2007/09/19_19:06:19 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[739]: 2007/09/19_19:06:19 info: log_cib_diff: cib_modify: Diff: --- 0.72.35 tengine[2002]: 2007/09/19_19:06:19 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:06:19 info: log_cib_diff: cib_modify: Diff: +++ 0.72.36 tengine[2002]: 2007/09/19_19:06:19 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:06:19 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:06:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:19 info: log_cib_diff: cib_update: Diff: --- 0.72.36 cibmon[739]: 2007/09/19_19:06:19 info: log_cib_diff: cib_update: Diff: +++ 0.72.37 cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:19 info: match_graph_event: Action share-FS_start_0 (21) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:19 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:06:19 notice: run_graph: Transition 15: (Complete=14, Pending=0, Fired=0, Skipped=3, Incomplete=0) cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:06:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:19 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:06:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:06:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:06:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:06:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[2003]: 2007/09/19_19:06:19 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:06:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:06:19 info: process_pe_message: Transition 16: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-65.bz2 tengine[2002]: 2007/09/19_19:06:19 info: unpack_graph: Unpacked transition 16: 3 actions in 3 synapses tengine[2002]: 2007/09/19_19:06:19 info: send_rsc_command: Initiating action 12: share-drbdlinks_start_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:06:19 info: send_rsc_command: Initiating action 16: share-FS_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:06:21 info: log_cib_diff: cib_update: Diff: --- 0.72.37 tengine[2002]: 2007/09/19_19:06:21 info: match_graph_event: Action share-drbdlinks_start_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:21 info: log_cib_diff: cib_update: Diff: +++ 0.72.38 tengine[2002]: 2007/09/19_19:06:21 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:21 info: match_graph_event: Action share-FS_monitor_120000 (16) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:21 info: log_cib_diff: cib_update: Diff: --- 0.72.38 cibmon[739]: 2007/09/19_19:06:21 info: log_cib_diff: cib_update: Diff: +++ 0.72.39 cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:21 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:06:22 info: match_graph_event: Action share-drbdlinks_monitor_120000 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:06:22 info: log_cib_diff: cib_update: Diff: --- 0.72.39 crmd[745]: 2007/09/19_19:06:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:06:22 info: run_graph: Transition 16: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:06:22 info: log_cib_diff: cib_update: Diff: +++ 0.72.40 tengine[2002]: 2007/09/19_19:06:22 info: notify_crmd: Transition 16 status: te_complete - cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:06:22 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:06:51 info: sync_our_cib: Syncing CIB to all peers cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:07:47 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cibmon[739]: 2007/09/19_19:07:47 info: log_cib_diff: cib_create: Diff: --- 0.72.40 cibmon[739]: 2007/09/19_19:07:47 info: log_cib_diff: cib_create: Diff: +++ 0.73.1 cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: - tengine[2002]: 2007/09/19_19:07:47 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + crmd[745]: 2007/09/19_19:07:47 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + crmd[745]: 2007/09/19_19:07:47 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:07:47 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' crmd[745]: 2007/09/19_19:07:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:07:47 info: unpack_graph: Unpacked transition 17: 3 actions in 3 synapses pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[745]: 2007/09/19_19:07:47 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=22:17:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:07:47 info: send_rsc_command: Initiating action 22: msg_first_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:07:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:07:47 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=21, rc=-2) Cancelled pengine[2003]: 2007/09/19_19:07:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:07:47 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:07:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:07:47 notice: StartRsc: host-2.awale.qc.ca Start msg_first cib[6053]: 2007/09/19_19:07:47 info: write_cib_contents: Wrote version 0.73.1 of the CIB to disk (digest: cf9f7cc45a1a4165144b38846e7b4411) pengine[2003]: 2007/09/19_19:07:47 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:07:47 info: process_pe_message: Transition 17: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-66.bz2 cibmon[739]: 2007/09/19_19:07:47 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:07:47 info: log_cib_diff: cib_delete: Diff: --- 0.73.1 cibmon[739]: 2007/09/19_19:07:47 info: log_cib_diff: cib_delete: Diff: +++ 0.73.2 cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:07:47 info: log_data_element: cib_delete: + msg[6054][6075]: 2007/09/19_19:07:47 INFO Completed switching away from this node. msg[6054][6076]: 2007/09/19_19:07:47 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:07:48 info: process_lrm_event: LRM operation msg_first_stop_0 (call=46, rc=0) complete cibmon[739]: 2007/09/19_19:07:48 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:07:48 info: match_graph_event: Action msg_first_stop_0 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:07:48 info: log_cib_diff: cib_update: Diff: --- 0.73.2 tengine[2002]: 2007/09/19_19:07:48 info: send_rsc_command: Initiating action 23: msg_first_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:07:48 info: log_cib_diff: cib_update: Diff: +++ 0.73.3 cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:48 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:07:49 info: log_cib_diff: cib_update: Diff: --- 0.73.3 cibmon[739]: 2007/09/19_19:07:49 info: log_cib_diff: cib_update: Diff: +++ 0.73.4 cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:07:49 info: match_graph_event: Action msg_first_start_0 (23) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:07:49 info: send_rsc_command: Initiating action 24: msg_first_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:49 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:07:50 info: match_graph_event: Action msg_first_monitor_120000 (24) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:07:50 info: log_cib_diff: cib_update: Diff: --- 0.73.4 tengine[2002]: 2007/09/19_19:07:50 info: run_graph: Transition 17: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:07:50 info: log_cib_diff: cib_update: Diff: +++ 0.73.5 crmd[745]: 2007/09/19_19:07:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:07:50 info: notify_crmd: Transition 17 status: te_complete - cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:07:50 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_create: Diff: --- 0.73.5 cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_create: Diff: +++ 0.74.1 cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: - tengine[2002]: 2007/09/19_19:08:00 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + crmd[745]: 2007/09/19_19:08:00 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + crmd[745]: 2007/09/19_19:08:00 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:08:00 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:08:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:08:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:08:00 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:08:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:08:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cib[6130]: 2007/09/19_19:08:00 info: write_cib_contents: Wrote version 0.74.1 of the CIB to disk (digest: f5d1ada59f7c2f488095450d55fb4259) tengine[2002]: 2007/09/19_19:08:00 info: unpack_graph: Unpacked transition 18: 6 actions in 6 synapses pengine[2003]: 2007/09/19_19:08:00 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:08:00 info: send_rsc_command: Initiating action 22: msg_first_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:08:00 info: send_rsc_command: Initiating action 25: msg_last_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:08:00 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=25:18:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:08:00 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=45, rc=-2) Cancelled pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Move resource msg_first (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:08:00 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[2003]: 2007/09/19_19:08:00 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[2003]: 2007/09/19_19:08:00 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:08:00 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:08:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:08:00 info: process_pe_message: Transition 18: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-67.bz2 cibmon[739]: 2007/09/19_19:08:00 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_delete: Diff: --- 0.74.1 cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_delete: Diff: +++ 0.74.2 cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_delete: + msg[6132][6153]: 2007/09/19_19:08:00 INFO Starting to switch away from this node. msg[6132][6154]: 2007/09/19_19:08:00 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:08:00 info: process_lrm_event: LRM operation msg_last_stop_0 (call=47, rc=0) complete cibmon[739]: 2007/09/19_19:08:00 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_update: Diff: --- 0.74.2 cibmon[739]: 2007/09/19_19:08:00 info: log_cib_diff: cib_update: Diff: +++ 0.74.3 cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:00 info: match_graph_event: Action msg_last_stop_0 (25) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:00 info: send_rsc_command: Initiating action 26: msg_last_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:00 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_delete: Diff: --- 0.74.3 cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_delete: Diff: +++ 0.74.4 cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:08:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: --- 0.74.4 cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: +++ 0.74.5 cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:01 info: match_graph_event: Action msg_last_start_0 (26) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:01 info: send_rsc_command: Initiating action 27: msg_last_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: --- 0.74.5 cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: +++ 0.74.6 cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:08:01 info: match_graph_event: Action msg_first_stop_0 (22) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:08:01 info: send_rsc_command: Initiating action 23: msg_first_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:08:01 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=23:18:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + msg[6164][6185]: 2007/09/19_19:08:01 INFO Starting to switch to this node. msg[6164][6186]: 2007/09/19_19:08:01 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:08:01 info: process_lrm_event: LRM operation msg_first_start_0 (call=48, rc=0) complete crmd[745]: 2007/09/19_19:08:01 info: build_operation_update: Digest for 0:0;23:18:2974a93a-aeed-4483-8a7a-4557ddb8520f (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[745]: 2007/09/19_19:08:01 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:08:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: --- 0.74.6 cibmon[739]: 2007/09/19_19:08:01 info: log_cib_diff: cib_update: Diff: +++ 0.74.7 cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:01 info: match_graph_event: Action msg_first_start_0 (23) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:08:01 info: send_rsc_command: Initiating action 24: msg_first_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:08:01 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=24:18:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:01 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:08:02 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=49, rc=0) complete cibmon[739]: 2007/09/19_19:08:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:02 info: log_cib_diff: cib_update: Diff: --- 0.74.7 cibmon[739]: 2007/09/19_19:08:02 info: log_cib_diff: cib_update: Diff: +++ 0.74.8 cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:08:02 info: match_graph_event: Action msg_first_monitor_120000 (24) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:08:03 info: log_cib_diff: cib_update: Diff: --- 0.74.8 cibmon[739]: 2007/09/19_19:08:03 info: log_cib_diff: cib_update: Diff: +++ 0.74.9 cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:08:03 info: match_graph_event: Action msg_last_monitor_120000 (27) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:08:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:08:03 info: run_graph: Transition 18: (Complete=6, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:08:03 info: notify_crmd: Transition 18 status: te_complete - cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:08:03 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:08:58 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:08:58 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:08:58 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:08:58 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:08:58 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:08:58 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:08:58 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:08:58 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:08:58 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:08:58 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:08:58 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:08:58 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:08:58 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:08:58 info: MSG[3] : [cib_section=constraints] cib[741]: 2007/09/19_19:08:58 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:08:58 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:08:58 info: MSG[6] : [(2)cib_calldata=0x95b8468(120 154)] cib[741]: 2007/09/19_19:08:58 info: cib[741]: 2007/09/19_19:08:58 info: MSG[7] : [cib_clientid=20229fca-747b-46a3-bd67-4ffa3788d70c] cib[741]: 2007/09/19_19:08:58 info: MSG[8] : [cib_clientname=6386] cibmon[739]: 2007/09/19_19:09:05 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cibmon[739]: 2007/09/19_19:09:05 info: log_cib_diff: cib_create: Diff: --- 0.74.9 cibmon[739]: 2007/09/19_19:09:05 info: log_cib_diff: cib_create: Diff: +++ 0.75.1 cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: - cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + tengine[2002]: 2007/09/19_19:09:05 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:09:05 info: log_data_element: cib_create: + crmd[745]: 2007/09/19_19:09:05 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:09:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:09:05 info: log_data_element: cib:diff: + cib[6404]: 2007/09/19_19:09:05 info: write_cib_contents: Wrote version 0.75.1 of the CIB to disk (digest: a65aaa57725cc3316a57d3c8875a678b) pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:09:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:09:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:09:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:09:05 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:09:05 info: unpack_graph: Unpacked transition 19: 9 actions in 9 synapses pengine[2003]: 2007/09/19_19:09:05 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:09:05 info: send_rsc_command: Initiating action 25: msg_last_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:09:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:09:05 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[2003]: 2007/09/19_19:09:05 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Move resource msg_last (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: StopRsc: host-2.awale.qc.ca Stop msg_last pengine[2003]: 2007/09/19_19:09:05 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:09:05 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:09:05 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:05 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[2003]: 2007/09/19_19:09:05 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[2003]: 2007/09/19_19:09:05 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[2003]: 2007/09/19_19:09:05 info: process_pe_message: Transition 19: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-68.bz2 cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: --- 0.75.1 cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: +++ 0.75.2 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:09:06 info: match_graph_event: Action msg_last_stop_0 (25) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: --- 0.75.2 tengine[2002]: 2007/09/19_19:09:06 info: send_rsc_command: Initiating action 28: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: +++ 0.75.3 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:09:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=28:19:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:09:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=15, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: --- 0.75.3 cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: +++ 0.75.4 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: + lrmd[742]: 2007/09/19_19:09:06 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop lrmd[742]: 2007/09/19_19:09:06 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process IPaddr[6420][6435]: 2007/09/19_19:09:06 INFO: ifconfig eth0:0 down crmd[745]: 2007/09/19_19:09:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=50, rc=0) complete cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: --- 0.75.4 cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: +++ 0.75.5 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:09:06 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (28) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:09:06 info: send_rsc_command: Initiating action 22: msg_first_stop_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:09:06 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=22:19:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:09:06 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=49, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: --- 0.75.5 cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_delete: Diff: +++ 0.75.6 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_delete: + msg[6438][6459]: 2007/09/19_19:09:06 INFO Completed switching away from this node. msg[6438][6460]: 2007/09/19_19:09:06 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:09:06 info: process_lrm_event: LRM operation msg_first_stop_0 (call=51, rc=0) complete cibmon[739]: 2007/09/19_19:09:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: --- 0.75.6 cibmon[739]: 2007/09/19_19:09:06 info: log_cib_diff: cib_update: Diff: +++ 0.75.7 cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:09:06 info: match_graph_event: Action msg_first_stop_0 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:09:06 info: send_rsc_command: Initiating action 23: msg_first_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:06 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:09:08 info: match_graph_event: Action msg_first_start_0 (23) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:08 info: log_cib_diff: cib_update: Diff: --- 0.75.7 tengine[2002]: 2007/09/19_19:09:08 info: send_rsc_command: Initiating action 24: msg_first_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:08 info: log_cib_diff: cib_update: Diff: +++ 0.75.8 tengine[2002]: 2007/09/19_19:09:08 info: send_rsc_command: Initiating action 29: IPaddr_10_0_0_59_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:08 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:09:09 info: log_cib_diff: cib_update: Diff: --- 0.75.8 cibmon[739]: 2007/09/19_19:09:09 info: log_cib_diff: cib_update: Diff: +++ 0.75.9 cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:09:09 info: match_graph_event: Action msg_first_monitor_120000 (24) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:09:09 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (29) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:09 info: log_cib_diff: cib_update: Diff: --- 0.75.9 tengine[2002]: 2007/09/19_19:09:09 info: send_rsc_command: Initiating action 26: msg_last_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:09 info: log_cib_diff: cib_update: Diff: +++ 0.75.10 crmd[745]: 2007/09/19_19:09:09 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=26:19:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:09:09 info: send_rsc_command: Initiating action 30: IPaddr_10_0_0_59_monitor_5000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:09 info: log_data_element: cib_update: + msg[6470][6491]: 2007/09/19_19:09:10 INFO Completed switching to this node. msg[6470][6492]: 2007/09/19_19:09:10 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:09:10 info: process_lrm_event: LRM operation msg_last_start_0 (call=52, rc=0) complete crmd[745]: 2007/09/19_19:09:10 info: build_operation_update: Digest for 0:0;26:19:2974a93a-aeed-4483-8a7a-4557ddb8520f (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[745]: 2007/09/19_19:09:10 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:09:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:09:10 info: match_graph_event: Action msg_last_start_0 (26) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:10 info: log_cib_diff: cib_update: Diff: --- 0.75.10 tengine[2002]: 2007/09/19_19:09:10 info: send_rsc_command: Initiating action 27: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:10 info: log_cib_diff: cib_update: Diff: +++ 0.75.11 cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:09:10 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=27:19:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:09:10 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=53, rc=0) complete cibmon[739]: 2007/09/19_19:09:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:09:10 info: match_graph_event: Action msg_last_monitor_120000 (27) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:09:10 info: log_cib_diff: cib_update: Diff: --- 0.75.11 cibmon[739]: 2007/09/19_19:09:10 info: log_cib_diff: cib_update: Diff: +++ 0.75.12 cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:10 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:09:11 info: log_cib_diff: cib_update: Diff: --- 0.75.12 cibmon[739]: 2007/09/19_19:09:11 info: log_cib_diff: cib_update: Diff: +++ 0.75.13 cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:09:11 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (30) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:09:11 info: run_graph: Transition 19: (Complete=9, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:09:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:09:11 info: notify_crmd: Transition 19 status: te_complete - cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:11 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:29 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:09:29 info: log_cib_diff: cib_delete: Diff: --- 0.75.13 cibmon[739]: 2007/09/19_19:09:29 info: log_cib_diff: cib_delete: Diff: +++ 0.75.14 cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:09:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:09:29 info: log_cib_diff: cib_update: Diff: --- 0.75.14 cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_cib_diff: cib_update: Diff: +++ 0.76.1 cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + tengine[2002]: 2007/09/19_19:09:29 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:09:29 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:09:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:09:29 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:09:29 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[6520]: 2007/09/19_19:09:29 info: write_cib_contents: Wrote version 0.76.1 of the CIB to disk (digest: a72d47bb10528fa6111a22865b157a50) pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:09:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:09:29 info: unpack_graph: Unpacked transition 20: 0 actions in 0 synapses pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:09:29 info: run_graph: Transition 20: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:09:29 info: notify_crmd: Transition 20 status: te_complete - pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:09:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:09:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:09:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:09:29 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:09:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource mysql (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:09:29 info: process_pe_message: Transition 20: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-69.bz2 cibmon[739]: 2007/09/19_19:10:24 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:10:24 info: log_cib_diff: cib_delete: Diff: --- 0.76.1 cibmon[739]: 2007/09/19_19:10:24 info: log_cib_diff: cib_delete: Diff: +++ 0.76.2 cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:10:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[745]: 2007/09/19_19:10:24 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:10:24 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:10:24 info: log_cib_diff: cib_update: Diff: --- 0.76.2 crmd[745]: 2007/09/19_19:10:24 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_cib_diff: cib_update: Diff: +++ 0.77.1 cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:10:24 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:24 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:10:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:10:24 info: unpack_graph: Unpacked transition 21: 3 actions in 3 synapses pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:10:24 info: send_rsc_command: Initiating action 20: mysql_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:10:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:10:24 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca cib[6542]: 2007/09/19_19:10:24 info: write_cib_contents: Wrote version 0.77.1 of the CIB to disk (digest: 4205e0eb30981389325e1fce144c8f55) pengine[2003]: 2007/09/19_19:10:24 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:10:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[2003]: 2007/09/19_19:10:24 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:10:24 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:10:24 info: process_pe_message: Transition 21: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-70.bz2 cibmon[739]: 2007/09/19_19:10:25 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:10:25 info: log_cib_diff: cib_delete: Diff: --- 0.77.1 cibmon[739]: 2007/09/19_19:10:25 info: log_cib_diff: cib_delete: Diff: +++ 0.77.2 cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:10:25 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:10:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:10:27 info: log_cib_diff: cib_update: Diff: --- 0.77.2 cibmon[739]: 2007/09/19_19:10:27 info: log_cib_diff: cib_update: Diff: +++ 0.77.3 cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:10:27 info: match_graph_event: Action mysql_stop_0 (20) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:10:28 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=21:21:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:10:27 info: send_rsc_command: Initiating action 21: mysql_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:27 info: log_data_element: cib_update: + mysql[6544][6610]: 2007/09/19_19:10:32 INFO: MySQL started crmd[745]: 2007/09/19_19:10:32 info: process_lrm_event: LRM operation mysql_start_0 (call=54, rc=0) complete crmd[745]: 2007/09/19_19:10:32 info: build_operation_update: Digest for 0:0;21:21:2974a93a-aeed-4483-8a7a-4557ddb8520f (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[745]: 2007/09/19_19:10:32 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:10:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:10:32 info: match_graph_event: Action mysql_start_0 (21) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:10:32 info: log_cib_diff: cib_update: Diff: --- 0.77.3 tengine[2002]: 2007/09/19_19:10:32 info: send_rsc_command: Initiating action 22: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:10:32 info: log_cib_diff: cib_update: Diff: +++ 0.77.4 cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:10:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=22:21:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:10:32 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=55, rc=0) complete cibmon[739]: 2007/09/19_19:10:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:10:32 info: log_cib_diff: cib_update: Diff: --- 0.77.4 cibmon[739]: 2007/09/19_19:10:32 info: log_cib_diff: cib_update: Diff: +++ 0.77.5 cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:10:32 info: match_graph_event: Action mysql_monitor_120000 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:10:32 info: run_graph: Transition 21: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:10:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:10:32 info: notify_crmd: Transition 21 status: te_complete - cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:10:32 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:53 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_delete: Diff: --- 0.77.5 cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_delete: Diff: +++ 0.77.6 cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:11:53 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - tengine[2002]: 2007/09/19_19:11:53 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_update: Diff: --- 0.77.6 cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_update: Diff: +++ 0.78.1 cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:11:53 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:11:53 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:11:53 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_update: + cib[6652]: 2007/09/19_19:11:53 info: write_cib_contents: Wrote version 0.78.1 of the CIB to disk (digest: 6cec576eafd3e5f79826661ffdca2162) pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:11:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:11:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:11:53 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:11:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:11:53 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:11:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:11:53 info: unpack_graph: Unpacked transition 22: 3 actions in 3 synapses pengine[2003]: 2007/09/19_19:11:53 notice: StopRsc: host-1.awale.qc.ca Stop mysql tengine[2002]: 2007/09/19_19:11:53 info: send_rsc_command: Initiating action 20: mysql_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:11:53 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:11:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:11:53 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=20:22:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:11:53 info: process_pe_message: Transition 22: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-71.bz2 crmd[745]: 2007/09/19_19:11:53 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=55, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:11:53 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_delete: Diff: --- 0.78.1 cibmon[739]: 2007/09/19_19:11:53 info: log_cib_diff: cib_delete: Diff: +++ 0.78.2 cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:11:53 info: log_data_element: cib_delete: + mysql[6654][6676]: 2007/09/19_19:11:56 INFO: MySQL stopped crmd[745]: 2007/09/19_19:11:56 info: process_lrm_event: LRM operation mysql_stop_0 (call=56, rc=0) complete cibmon[739]: 2007/09/19_19:11:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:11:56 info: log_cib_diff: cib_update: Diff: --- 0.78.2 cibmon[739]: 2007/09/19_19:11:56 info: log_cib_diff: cib_update: Diff: +++ 0.78.3 cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:11:56 info: match_graph_event: Action mysql_stop_0 (20) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:11:56 info: send_rsc_command: Initiating action 21: mysql_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:11:56 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:12:02 info: log_cib_diff: cib_update: Diff: --- 0.78.3 cibmon[739]: 2007/09/19_19:12:02 info: log_cib_diff: cib_update: Diff: +++ 0.78.4 tengine[2002]: 2007/09/19_19:12:02 info: match_graph_event: Action mysql_start_0 (21) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:12:02 info: send_rsc_command: Initiating action 22: mysql_monitor_120000 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:12:04 info: log_cib_diff: cib_update: Diff: --- 0.78.4 cibmon[739]: 2007/09/19_19:12:04 info: log_cib_diff: cib_update: Diff: +++ 0.78.5 tengine[2002]: 2007/09/19_19:12:04 info: match_graph_event: Action mysql_monitor_120000 (22) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:12:04 info: run_graph: Transition 22: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:12:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:12:04 info: notify_crmd: Transition 22 status: te_complete - cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:12:04 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:15:54 info: cib_stats: Processed 100 operations (11400.00us average, 0% utilization) in the last 10min crmd[745]: 2007/09/19_19:21:41 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) cibmon[739]: 2007/09/19_19:22:15 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:22:15 info: log_cib_diff: cib_delete: Diff: --- 0.78.5 cibmon[739]: 2007/09/19_19:22:15 info: log_cib_diff: cib_delete: Diff: +++ 0.78.6 cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:22:15 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:22:15 info: log_cib_diff: cib_update: Diff: --- 0.78.6 cibmon[739]: 2007/09/19_19:22:15 info: log_cib_diff: cib_update: Diff: +++ 0.79.1 cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:22:15 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:22:15 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:22:15 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:22:15 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:22:15 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:22:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:22:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:22:15 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:22:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:22:15 info: unpack_graph: Unpacked transition 23: 3 actions in 3 synapses pengine[2003]: 2007/09/19_19:22:15 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:22:15 info: send_rsc_command: Initiating action 20: mysql_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:22:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[2003]: 2007/09/19_19:22:15 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:22:15 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:22:15 info: process_pe_message: Transition 23: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-72.bz2 cib[6872]: 2007/09/19_19:22:15 info: write_cib_contents: Wrote version 0.79.1 of the CIB to disk (digest: eba03a3786e0d818485ae9cacd60d527) cibmon[739]: 2007/09/19_19:22:16 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:22:16 info: log_cib_diff: cib_delete: Diff: --- 0.79.1 cibmon[739]: 2007/09/19_19:22:16 info: log_cib_diff: cib_delete: Diff: +++ 0.79.2 cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:22:16 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:22:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:22:20 info: log_cib_diff: cib_update: Diff: --- 0.79.2 cibmon[739]: 2007/09/19_19:22:20 info: log_cib_diff: cib_update: Diff: +++ 0.79.3 tengine[2002]: 2007/09/19_19:22:20 info: match_graph_event: Action mysql_stop_0 (20) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:22:20 info: send_rsc_command: Initiating action 21: mysql_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:22:20 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=21:23:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:20 info: log_data_element: cib_update: + mysql[6873][6950]: 2007/09/19_19:22:24 INFO: MySQL started crmd[745]: 2007/09/19_19:22:24 info: process_lrm_event: LRM operation mysql_start_0 (call=57, rc=0) complete crmd[745]: 2007/09/19_19:22:24 info: build_operation_update: Digest for 0:0;21:23:2974a93a-aeed-4483-8a7a-4557ddb8520f (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[745]: 2007/09/19_19:22:24 info: log_data_element: build_operation_update: digest:source cibmon[739]: 2007/09/19_19:22:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:22:24 info: log_cib_diff: cib_update: Diff: --- 0.79.3 cibmon[739]: 2007/09/19_19:22:24 info: log_cib_diff: cib_update: Diff: +++ 0.79.4 cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:22:24 info: match_graph_event: Action mysql_start_0 (21) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:22:24 info: send_rsc_command: Initiating action 22: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:22:24 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=22:23:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:22:24 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=58, rc=0) complete cibmon[739]: 2007/09/19_19:22:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:22:24 info: log_cib_diff: cib_update: Diff: --- 0.79.4 cibmon[739]: 2007/09/19_19:22:24 info: log_cib_diff: cib_update: Diff: +++ 0.79.5 tengine[2002]: 2007/09/19_19:22:24 info: match_graph_event: Action mysql_monitor_120000 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:22:24 info: run_graph: Transition 23: (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:22:24 info: notify_crmd: Transition 23 status: te_complete - cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:22:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:22:24 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:23:15 WARN: do_cib_notify: cib_modify of FAILED: The object/attribute does not exist cib[741]: 2007/09/19_19:23:15 ERROR: cib_process_request: cib_modify operation failed: The object/attribute does not exist cib[741]: 2007/09/19_19:23:15 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:23:15 info: MSG: Dumping message with 8 fields cib[741]: 2007/09/19_19:23:15 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:23:15 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:23:15 info: MSG[2] : [cib_op=cib_modify] cib[741]: 2007/09/19_19:23:15 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_19:23:15 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:23:15 info: MSG[5] : [(2)cib_calldata=0x95da698(66 82)] cib[741]: 2007/09/19_19:23:15 info: cib[741]: 2007/09/19_19:23:15 info: MSG[6] : [cib_clientid=902c6102-06df-4ec7-98fd-98ac1913f59a] cib[741]: 2007/09/19_19:23:15 info: MSG[7] : [cib_clientname=6989] cibmon[739]: 2007/09/19_19:23:43 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed crmd[745]: 2007/09/19_19:23:43 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:23:43 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:23:43 info: log_cib_diff: cib_modify: Diff: --- 0.79.5 crmd[745]: 2007/09/19_19:23:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_cib_diff: cib_modify: Diff: +++ 0.80.1 cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:23:43 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:23:43 info: log_data_element: cib_modify: + pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:23:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:23:43 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:23:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:23:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:23:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca cib[6994]: 2007/09/19_19:23:43 info: write_cib_contents: Wrote version 0.80.1 of the CIB to disk (digest: 537344c4c41817f27af31b6e3af755c8) tengine[2002]: 2007/09/19_19:23:43 info: unpack_graph: Unpacked transition 24: 0 actions in 0 synapses pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:23:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:23:43 info: run_graph: Transition 24: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:23:43 info: notify_crmd: Transition 24 status: te_complete - pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:23:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:23:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:23:43 info: process_pe_message: Transition 24: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-73.bz2 cibmon[739]: 2007/09/19_19:24:01 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:24:01 info: log_cib_diff: cib_modify: Local-only Change: 0.81.1 cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:01 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:24:01 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:24:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:01 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:01 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cib[7000]: 2007/09/19_19:24:01 info: write_cib_contents: Wrote version 0.81.1 of the CIB to disk (digest: d1f2b5a1615ed2011ca3e56c6be5f587) pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:24:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:24:01 info: unpack_graph: Unpacked transition 25: 0 actions in 0 synapses pengine[2003]: 2007/09/19_19:24:01 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:24:01 info: run_graph: Transition 25: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_19:24:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:01 info: notify_crmd: Transition 25 status: te_complete - pengine[2003]: 2007/09/19_19:24:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:24:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:01 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:01 info: process_pe_message: Transition 25: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-74.bz2 cibmon[739]: 2007/09/19_19:24:03 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:24:03 info: log_cib_diff: cib_modify: Local-only Change: 0.82.1 cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:03 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:24:03 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - crmd[745]: 2007/09/19_19:24:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:03 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:03 info: log_data_element: cib:diff: + pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:24:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:24:03 info: unpack_graph: Unpacked transition 26: 0 actions in 0 synapses pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:03 info: run_graph: Transition 26: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:03 info: notify_crmd: Transition 26 status: te_complete - pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cib[7003]: 2007/09/19_19:24:03 info: write_cib_contents: Wrote version 0.82.1 of the CIB to disk (digest: f0fc0755cb9fdc66623d4ec11715d24e) pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:03 info: process_pe_message: Transition 26: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-75.bz2 cib[741]: 2007/09/19_19:24:11 WARN: do_cib_notify: cib_modify of FAILED: The object/attribute does not exist cib[741]: 2007/09/19_19:24:11 ERROR: cib_process_request: cib_modify operation failed: The object/attribute does not exist cib[741]: 2007/09/19_19:24:11 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:24:11 info: MSG: Dumping message with 8 fields cib[741]: 2007/09/19_19:24:11 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:24:11 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:24:11 info: MSG[2] : [cib_op=cib_modify] cib[741]: 2007/09/19_19:24:11 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_19:24:11 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:24:11 info: MSG[5] : [(2)cib_calldata=0x94daa00(79 95)] cib[741]: 2007/09/19_19:24:11 info: cib[741]: 2007/09/19_19:24:11 info: MSG[6] : [cib_clientid=7890ec91-ab9e-4323-9878-4f1f87b4d1e7] cib[741]: 2007/09/19_19:24:11 info: MSG[7] : [cib_clientname=7004] cibmon[739]: 2007/09/19_19:24:23 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:24:23 info: log_cib_diff: cib_modify: Local-only Change: 0.83.1 cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:23 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + crmd[745]: 2007/09/19_19:24:23 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + crmd[745]: 2007/09/19_19:24:23 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:23 info: log_data_element: cib:diff: + cib[7017]: 2007/09/19_19:24:23 info: write_cib_contents: Wrote version 0.83.1 of the CIB to disk (digest: 6c7f6184fb950cca8e9eef7d3b8d4f08) pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:23 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:23 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:23 info: unpack_graph: Unpacked transition 27: 3 actions in 3 synapses pengine[2003]: 2007/09/19_19:24:23 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:24:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:23 info: send_rsc_command: Initiating action 20: mysql_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:24:23 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=20:27:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:24:23 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[2003]: 2007/09/19_19:24:23 notice: StartRsc: host-2.awale.qc.ca Start mysql crmd[745]: 2007/09/19_19:24:23 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=58, rc=-2) Cancelled pengine[2003]: 2007/09/19_19:24:23 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:23 info: process_pe_message: Transition 27: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-76.bz2 cibmon[739]: 2007/09/19_19:24:23 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:24:23 info: log_cib_diff: cib_delete: Diff: --- 0.83.1 cibmon[739]: 2007/09/19_19:24:23 info: log_cib_diff: cib_delete: Diff: +++ 0.83.2 cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:23 info: log_data_element: cib_delete: + mysql[7018][7040]: 2007/09/19_19:24:26 INFO: MySQL stopped crmd[745]: 2007/09/19_19:24:26 info: process_lrm_event: LRM operation mysql_stop_0 (call=59, rc=0) complete cibmon[739]: 2007/09/19_19:24:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:24:26 info: log_cib_diff: cib_update: Diff: --- 0.83.2 cibmon[739]: 2007/09/19_19:24:26 info: log_cib_diff: cib_update: Diff: +++ 0.83.3 tengine[2002]: 2007/09/19_19:24:26 info: match_graph_event: Action mysql_stop_0 (20) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:24:26 info: send_rsc_command: Initiating action 21: mysql_start_0 on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:26 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:24:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244271-6 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:28 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:28 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:28 info: match_graph_event: Action mysql_start_0 (21) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:28 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:28 notice: run_graph: Transition 27: (Complete=2, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:28 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:24:28 info: unpack_graph: Unpacked transition 28: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:28 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:28 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:28 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:28 info: process_pe_message: Transition 28: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-77.bz2 tengine[2002]: 2007/09/19_19:24:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244273-7 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:29 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:29 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:29 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:29 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:29 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:29 notice: run_graph: Transition 28: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:24:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:24:29 info: unpack_graph: Unpacked transition 29: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:24:29 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:29 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:29 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:29 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:29 info: process_pe_message: Transition 29: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-78.bz2 tengine[2002]: 2007/09/19_19:24:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244275-8 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:31 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:31 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:31 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:31 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:24:31 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:31 notice: run_graph: Transition 29: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:31 info: unpack_graph: Unpacked transition 30: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:31 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:31 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:31 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:31 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:31 info: process_pe_message: Transition 30: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-79.bz2 cibmon[739]: 2007/09/19_19:24:32 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:24:32 info: log_cib_diff: cib_modify: Diff: --- 0.83.3 cibmon[739]: 2007/09/19_19:24:32 info: log_cib_diff: cib_modify: Diff: +++ 0.84.1 tengine[2002]: 2007/09/19_19:24:32 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:32 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:32 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:32 info: log_data_element: cib:diff: + cib[7044]: 2007/09/19_19:24:32 info: write_cib_contents: Wrote version 0.84.1 of the CIB to disk (digest: 79382ff70882c35e0644b613cdce2b6f) tengine[2002]: 2007/09/19_19:24:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244276-9 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:33 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:33 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:24:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:33 notice: run_graph: Transition 30: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:24:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:33 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:33 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:24:33 info: unpack_graph: Unpacked transition 31: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:33 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:33 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:33 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:33 info: process_pe_message: Transition 31: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-80.bz2 tengine[2002]: 2007/09/19_19:24:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244277-10 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:34 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:34 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:34 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:34 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:34 notice: run_graph: Transition 31: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:34 info: unpack_graph: Unpacked transition 32: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:34 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:34 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:34 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:34 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 info: process_pe_message: Transition 32: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-81.bz2 tengine[2002]: 2007/09/19_19:24:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244278-11 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:34 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:34 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:34 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:34 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:34 notice: run_graph: Transition 32: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:34 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:34 info: unpack_graph: Unpacked transition 33: 2 actions in 2 synapses pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:34 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:34 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:34 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:34 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:34 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:34 info: process_pe_message: Transition 33: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-82.bz2 cibmon[739]: 2007/09/19_19:24:35 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:24:35 info: log_cib_diff: cib_modify: Local-only Change: 0.85.1 cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:35 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:24:35 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:35 info: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:35 info: log_data_element: cib:diff: + cib[7047]: 2007/09/19_19:24:35 info: write_cib_contents: Wrote version 0.85.1 of the CIB to disk (digest: 58b24ab115ee9bf7f3d99fed7aa30c93) crmd[745]: 2007/09/19_19:24:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244279-12 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:36 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:36 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:36 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:36 notice: run_graph: Transition 33: (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0) pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[745]: 2007/09/19_19:24:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:36 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:36 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:36 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:36 info: unpack_graph: Unpacked transition 34: 5 actions in 5 synapses pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:24:36 info: send_rsc_command: Initiating action 19: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:24:36 info: send_rsc_command: Initiating action 23: msg_last_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:36 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:36 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 crmd[745]: 2007/09/19_19:24:36 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=23:34:2974a93a-aeed-4483-8a7a-4557ddb8520f) pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:36 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[2003]: 2007/09/19_19:24:36 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:36 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:36 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:36 info: process_pe_message: Transition 34: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-83.bz2 crmd[745]: 2007/09/19_19:24:36 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=53, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:24:36 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:24:36 info: log_cib_diff: cib_delete: Diff: --- 0.85.1 cibmon[739]: 2007/09/19_19:24:36 info: log_cib_diff: cib_delete: Diff: +++ 0.85.2 cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_delete: + msg[7049][7070]: 2007/09/19_19:24:36 INFO Starting to switch away from this node. msg[7049][7071]: 2007/09/19_19:24:36 INFO Node: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:24:36 info: process_lrm_event: LRM operation msg_last_stop_0 (call=60, rc=0) complete cibmon[739]: 2007/09/19_19:24:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:24:36 info: log_cib_diff: cib_update: Diff: --- 0.85.2 cibmon[739]: 2007/09/19_19:24:36 info: log_cib_diff: cib_update: Diff: +++ 0.85.3 cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:24:36 info: match_graph_event: Action msg_last_stop_0 (23) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:24:36 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:24:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244280-13 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:37 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:37 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:37 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:37 info: match_graph_event: Action mysql_start_0 (19) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:37 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:37 notice: run_graph: Transition 34: (Complete=2, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:24:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:37 info: unpack_graph: Unpacked transition 35: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:37 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:37 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:37 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:37 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:37 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:37 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:37 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:37 info: process_pe_message: Transition 35: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-84.bz2 tengine[2002]: 2007/09/19_19:24:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244281-14 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:38 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:38 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:38 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:38 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:38 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:38 notice: run_graph: Transition 35: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:38 info: unpack_graph: Unpacked transition 36: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:24:38 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:38 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:38 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:38 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:38 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:38 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:38 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:38 info: process_pe_message: Transition 36: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-85.bz2 tengine[2002]: 2007/09/19_19:24:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244282-15 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:39 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:39 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:39 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:39 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:39 notice: run_graph: Transition 36: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:24:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:39 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:39 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:39 info: unpack_graph: Unpacked transition 37: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:39 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:39 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:39 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:39 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:39 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:39 info: process_pe_message: Transition 37: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-86.bz2 cibmon[739]: 2007/09/19_19:24:40 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:24:40 info: log_cib_diff: cib_modify: Diff: --- 0.85.3 cibmon[739]: 2007/09/19_19:24:40 info: log_cib_diff: cib_modify: Diff: +++ 0.85.4 cibmon[739]: 2007/09/19_19:24:40 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:40 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:24:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244284-16 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:40 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:40 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:40 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:40 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:40 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:40 notice: run_graph: Transition 37: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:40 info: unpack_graph: Unpacked transition 38: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:40 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:40 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:40 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:40 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:40 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:40 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:40 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:40 info: process_pe_message: Transition 38: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-87.bz2 tengine[2002]: 2007/09/19_19:24:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244285-17 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:42 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:42 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:42 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:42 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:42 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:42 notice: run_graph: Transition 38: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:42 info: unpack_graph: Unpacked transition 39: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:42 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:42 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:42 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:42 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:42 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:42 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:42 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:42 info: process_pe_message: Transition 39: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-88.bz2 tengine[2002]: 2007/09/19_19:24:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244286-18 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:43 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:43 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:43 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:43 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:43 notice: run_graph: Transition 39: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:24:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:43 info: unpack_graph: Unpacked transition 40: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:24:43 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:43 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:43 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:43 info: process_pe_message: Transition 40: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-89.bz2 crmd[745]: 2007/09/19_19:24:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244287-19 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:44 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:44 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:44 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:44 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:44 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:44 notice: run_graph: Transition 40: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:24:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:44 info: unpack_graph: Unpacked transition 41: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:44 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:44 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:44 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:44 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:44 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:44 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:44 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:44 info: process_pe_message: Transition 41: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-90.bz2 cib[741]: 2007/09/19_19:24:44 WARN: do_cib_notify: cib_modify of FAILED: The object/attribute does not exist cib[741]: 2007/09/19_19:24:44 ERROR: cib_process_request: cib_modify operation failed: The object/attribute does not exist cib[741]: 2007/09/19_19:24:44 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:24:44 info: MSG: Dumping message with 8 fields cib[741]: 2007/09/19_19:24:44 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:24:44 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:24:44 info: MSG[2] : [cib_op=cib_modify] cib[741]: 2007/09/19_19:24:44 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_19:24:44 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:24:44 info: MSG[5] : [(2)cib_calldata=0x95f0010(76 92)] cib[741]: 2007/09/19_19:24:44 info: cib[741]: 2007/09/19_19:24:44 info: MSG[6] : [cib_clientid=90bfa71c-ae33-4fe5-b2af-f4f506320aae] cib[741]: 2007/09/19_19:24:44 info: MSG[7] : [cib_clientname=7084] tengine[2002]: 2007/09/19_19:24:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244289-20 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:45 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:45 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:45 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:45 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:45 notice: run_graph: Transition 41: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:24:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:24:45 info: unpack_graph: Unpacked transition 42: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:24:45 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:45 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:45 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:45 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:45 info: process_pe_message: Transition 42: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-91.bz2 tengine[2002]: 2007/09/19_19:24:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244290-21 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:47 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:47 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:47 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:47 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:24:47 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:47 notice: run_graph: Transition 42: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:24:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:47 info: unpack_graph: Unpacked transition 43: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:24:47 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:47 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:47 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:47 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:47 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:47 info: process_pe_message: Transition 43: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-92.bz2 tengine[2002]: 2007/09/19_19:24:48 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244291-22 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:48 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:48 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:48 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:48 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:48 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:48 notice: run_graph: Transition 43: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:24:48 info: unpack_graph: Unpacked transition 44: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:24:48 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:48 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:48 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:48 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:48 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:48 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:48 info: process_pe_message: Transition 44: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-93.bz2 tengine[2002]: 2007/09/19_19:24:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244292-23 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:49 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:49 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:49 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:49 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:49 notice: run_graph: Transition 44: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:24:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:24:49 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:49 info: unpack_graph: Unpacked transition 45: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:24:49 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:49 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:49 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:49 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:49 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:49 info: process_pe_message: Transition 45: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-94.bz2 cibmon[739]: 2007/09/19_19:24:50 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[2002]: 2007/09/19_19:24:50 info: update_abort_priority: Abort priority upgraded to 1000000 cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - tengine[2002]: 2007/09/19_19:24:50 info: update_abort_priority: Abort action 0 superceeded by 2 cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:24:50 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:24:50 info: log_cib_diff: cib_modify: Diff: --- 0.85.4 cibmon[739]: 2007/09/19_19:24:50 info: log_cib_diff: cib_modify: Diff: +++ 0.86.1 cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:24:50 info: log_data_element: cib_modify: + cib[7087]: 2007/09/19_19:24:50 info: write_cib_contents: Wrote version 0.86.1 of the CIB to disk (digest: 19d797d246bec35ddb4ef3ebd111bc42) tengine[2002]: 2007/09/19_19:24:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244294-24 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:50 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:50 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:50 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:50 notice: run_graph: Transition 45: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:24:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:24:51 info: unpack_graph: Unpacked transition 46: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:24:51 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:50 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:50 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:50 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:50 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:50 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:50 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 info: process_pe_message: Transition 46: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-95.bz2 crmd[745]: 2007/09/19_19:24:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:51 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244295-25 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:51 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:51 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:51 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:51 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:51 notice: run_graph: Transition 46: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:51 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:51 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:51 info: unpack_graph: Unpacked transition 47: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:51 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:51 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:51 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:51 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:51 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:51 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:51 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:52 info: process_pe_message: Transition 47: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-96.bz2 tengine[2002]: 2007/09/19_19:24:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244296-26 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:53 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:53 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:53 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:53 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:53 notice: run_graph: Transition 47: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:24:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:24:53 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:24:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:53 info: unpack_graph: Unpacked transition 48: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:24:53 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:53 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:53 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:53 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:53 info: process_pe_message: Transition 48: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-97.bz2 tengine[2002]: 2007/09/19_19:24:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244297-27 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:54 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:54 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:24:54 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:54 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:54 notice: run_graph: Transition 48: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:24:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:24:54 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:24:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:24:54 info: unpack_graph: Unpacked transition 49: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:24:54 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:54 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:54 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:54 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:54 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:54 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:54 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:54 info: process_pe_message: Transition 49: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-98.bz2 tengine[2002]: 2007/09/19_19:24:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244299-28 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:55 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:55 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:55 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:55 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:55 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:55 notice: run_graph: Transition 49: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:24:56 info: unpack_graph: Unpacked transition 50: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:24:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:56 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:56 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:56 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:56 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:56 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:56 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:56 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:56 info: process_pe_message: Transition 50: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-99.bz2 tengine[2002]: 2007/09/19_19:24:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244300-29 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:57 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:57 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:57 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:57 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:57 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:57 notice: run_graph: Transition 50: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:24:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:24:57 info: unpack_graph: Unpacked transition 51: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:24:57 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:57 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:57 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:57 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:57 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:57 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:57 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:57 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:57 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:57 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:57 info: process_pe_message: Transition 51: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-100.bz2 tengine[2002]: 2007/09/19_19:24:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244301-30 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:58 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:24:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:58 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:58 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:58 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:58 notice: run_graph: Transition 51: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:24:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:24:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:58 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:58 info: unpack_graph: Unpacked transition 52: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:58 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:58 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:58 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:58 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:58 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:58 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:58 info: process_pe_message: Transition 52: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-101.bz2 tengine[2002]: 2007/09/19_19:24:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244302-31 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:24:59 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:24:59 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:24:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:24:59 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:24:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:24:59 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:24:59 notice: run_graph: Transition 52: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:24:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:24:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:24:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:59 info: unpack_graph: Unpacked transition 53: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:24:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:24:59 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:24:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:24:59 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:24:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:24:59 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:24:59 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:24:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:24:59 info: process_pe_message: Transition 53: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-102.bz2 tengine[2002]: 2007/09/19_19:25:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244304-32 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:01 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:01 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:01 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:01 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:01 notice: run_graph: Transition 53: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:25:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:25:01 info: unpack_graph: Unpacked transition 54: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:01 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:01 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:01 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:01 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:01 info: process_pe_message: Transition 54: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-103.bz2 tengine[2002]: 2007/09/19_19:25:02 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244305-33 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:02 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:02 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:02 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:02 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:02 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:02 notice: run_graph: Transition 54: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:02 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:25:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:25:02 info: unpack_graph: Unpacked transition 55: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:02 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:02 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:02 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:02 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:02 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:02 info: process_pe_message: Transition 55: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-104.bz2 tengine[2002]: 2007/09/19_19:25:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244306-34 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:03 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:03 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:03 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:03 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:25:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:03 notice: run_graph: Transition 55: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:03 info: unpack_graph: Unpacked transition 56: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:03 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:03 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:03 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:03 info: process_pe_message: Transition 56: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-105.bz2 tengine[2002]: 2007/09/19_19:25:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244308-35 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:04 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:04 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:04 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:04 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:04 notice: run_graph: Transition 56: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:25:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:25:04 info: unpack_graph: Unpacked transition 57: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:25:04 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:04 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:04 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:04 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:04 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:04 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:04 info: process_pe_message: Transition 57: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-106.bz2 tengine[2002]: 2007/09/19_19:25:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244309-36 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:06 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:06 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:06 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:06 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:06 notice: run_graph: Transition 57: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:25:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:25:06 info: unpack_graph: Unpacked transition 58: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:06 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:06 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:06 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:06 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:06 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:06 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:06 info: process_pe_message: Transition 58: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-107.bz2 tengine[2002]: 2007/09/19_19:25:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244310-37 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:07 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:07 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:07 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:07 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:07 notice: run_graph: Transition 58: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:25:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:25:07 info: unpack_graph: Unpacked transition 59: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:07 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:25:07 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:07 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:07 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:07 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:07 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:07 info: process_pe_message: Transition 59: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-108.bz2 tengine[2002]: 2007/09/19_19:25:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244311-38 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:08 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:08 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:08 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:08 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:08 notice: run_graph: Transition 59: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:08 info: unpack_graph: Unpacked transition 60: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:08 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:08 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:08 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:08 info: process_pe_message: Transition 60: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-109.bz2 tengine[2002]: 2007/09/19_19:25:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244312-39 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:09 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:09 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:09 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:09 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:09 notice: run_graph: Transition 60: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[745]: 2007/09/19_19:25:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:25:09 info: unpack_graph: Unpacked transition 61: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:25:09 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:09 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:09 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:09 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:09 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:09 info: process_pe_message: Transition 61: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-110.bz2 tengine[2002]: 2007/09/19_19:25:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244313-40 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:10 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:10 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:10 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:10 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:10 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:10 notice: run_graph: Transition 61: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[745]: 2007/09/19_19:25:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:25:10 info: unpack_graph: Unpacked transition 62: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:25:10 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:10 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:10 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:10 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:10 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:10 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:10 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:10 info: process_pe_message: Transition 62: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-111.bz2 tengine[2002]: 2007/09/19_19:25:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244314-41 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:11 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:11 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:11 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:11 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:11 notice: run_graph: Transition 62: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:11 info: unpack_graph: Unpacked transition 63: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:11 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:11 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:11 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:11 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:11 info: process_pe_message: Transition 63: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-112.bz2 tengine[2002]: 2007/09/19_19:25:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244315-42 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:12 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:12 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:12 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:12 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:12 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:12 notice: run_graph: Transition 63: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:25:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:12 info: unpack_graph: Unpacked transition 64: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:12 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:12 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:12 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:12 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:12 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:12 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:12 info: process_pe_message: Transition 64: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-113.bz2 tengine[2002]: 2007/09/19_19:25:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244316-43 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:13 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:13 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:13 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:13 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:13 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:13 notice: run_graph: Transition 64: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:13 info: unpack_graph: Unpacked transition 65: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:13 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:13 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:13 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:13 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:13 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:13 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:13 info: process_pe_message: Transition 65: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-114.bz2 tengine[2002]: 2007/09/19_19:25:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244318-44 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:15 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:15 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:15 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:15 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:15 notice: run_graph: Transition 65: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:15 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:25:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:15 info: unpack_graph: Unpacked transition 66: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:25:15 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:15 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:15 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:15 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:15 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:15 info: process_pe_message: Transition 66: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-115.bz2 tengine[2002]: 2007/09/19_19:25:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244319-45 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:16 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:16 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:16 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:16 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:16 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:16 notice: run_graph: Transition 66: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:16 info: unpack_graph: Unpacked transition 67: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:16 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:16 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:16 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:16 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:16 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:16 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:16 info: process_pe_message: Transition 67: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-116.bz2 tengine[2002]: 2007/09/19_19:25:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244321-46 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:18 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:18 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:18 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:18 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:18 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:18 notice: run_graph: Transition 67: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:25:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:18 info: unpack_graph: Unpacked transition 68: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:18 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:18 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:18 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:18 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:18 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:18 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:18 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:18 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:18 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:18 info: process_pe_message: Transition 68: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-117.bz2 tengine[2002]: 2007/09/19_19:25:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244322-47 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:19 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:19 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:19 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:19 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:19 notice: run_graph: Transition 68: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:25:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:25:19 info: unpack_graph: Unpacked transition 69: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:25:19 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:19 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:19 info: process_pe_message: Transition 69: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-118.bz2 tengine[2002]: 2007/09/19_19:25:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244324-48 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:21 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:21 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:21 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:21 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:21 notice: run_graph: Transition 69: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:25:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:21 info: unpack_graph: Unpacked transition 70: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:25:21 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:21 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:21 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:21 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:21 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:21 info: process_pe_message: Transition 70: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-119.bz2 tengine[2002]: 2007/09/19_19:25:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244325-49 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:22 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:22 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:22 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:22 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:22 notice: run_graph: Transition 70: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[745]: 2007/09/19_19:25:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' tengine[2002]: 2007/09/19_19:25:22 info: unpack_graph: Unpacked transition 71: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:25:22 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:22 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:22 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:22 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:22 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:22 info: process_pe_message: Transition 71: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-120.bz2 tengine[2002]: 2007/09/19_19:25:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244327-50 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:24 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:24 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:24 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:24 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:24 notice: run_graph: Transition 71: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:24 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:24 info: unpack_graph: Unpacked transition 72: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:24 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:24 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:24 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:24 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:24 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:24 info: process_pe_message: Transition 72: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-121.bz2 tengine[2002]: 2007/09/19_19:25:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244328-51 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:25 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:25 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:25 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:25 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:25 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:25 notice: run_graph: Transition 72: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:25 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:25 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:25 info: unpack_graph: Unpacked transition 73: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:25 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:25:25 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:25 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:25 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:25 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:25 info: process_pe_message: Transition 73: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-122.bz2 tengine[2002]: 2007/09/19_19:25:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244330-52 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:27 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:27 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:27 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:27 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:27 notice: run_graph: Transition 73: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:27 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:27 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:27 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:27 info: unpack_graph: Unpacked transition 74: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:27 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:27 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:27 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:27 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:27 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:27 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:27 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:27 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:27 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:27 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:27 info: process_pe_message: Transition 74: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-123.bz2 tengine[2002]: 2007/09/19_19:25:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244331-53 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:28 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:28 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:28 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:28 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:28 notice: run_graph: Transition 74: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:25:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:25:28 info: unpack_graph: Unpacked transition 75: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:28 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:25:28 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:28 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:28 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:28 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:28 info: process_pe_message: Transition 75: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-124.bz2 tengine[2002]: 2007/09/19_19:25:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244332-54 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:29 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:29 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:29 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:29 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:29 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:29 notice: run_graph: Transition 75: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:29 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:25:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:29 info: unpack_graph: Unpacked transition 76: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:25:29 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:29 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:29 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:29 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:29 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:29 info: process_pe_message: Transition 76: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-125.bz2 tengine[2002]: 2007/09/19_19:25:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244333-55 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:30 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:30 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:30 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:30 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:30 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:30 notice: run_graph: Transition 76: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:25:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:25:30 info: unpack_graph: Unpacked transition 77: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:25:30 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:30 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:30 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:30 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:30 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:30 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:30 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:30 info: process_pe_message: Transition 77: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-126.bz2 tengine[2002]: 2007/09/19_19:25:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244335-56 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:32 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:32 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:32 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:32 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:32 notice: run_graph: Transition 77: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:32 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:32 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:32 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:25:32 info: unpack_graph: Unpacked transition 78: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:32 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:25:32 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:32 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:32 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:32 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:32 info: process_pe_message: Transition 78: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-127.bz2 tengine[2002]: 2007/09/19_19:25:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244337-57 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:33 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:33 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:33 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:33 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:33 notice: run_graph: Transition 78: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:25:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:25:33 info: unpack_graph: Unpacked transition 79: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:33 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:33 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:33 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:33 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:33 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:33 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:33 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:33 info: process_pe_message: Transition 79: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-128.bz2 tengine[2002]: 2007/09/19_19:25:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244338-58 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:35 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:35 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:35 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:35 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:35 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:35 notice: run_graph: Transition 79: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:35 info: unpack_graph: Unpacked transition 80: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:35 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:35 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:35 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:35 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:35 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:35 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:35 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:35 info: process_pe_message: Transition 80: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-129.bz2 cibmon[739]: 2007/09/19_19:25:35 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:25:35 info: log_cib_diff: cib_delete: Diff: --- 0.86.1 cibmon[739]: 2007/09/19_19:25:35 info: log_cib_diff: cib_delete: Diff: +++ 0.86.2 cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_delete: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - tengine[2002]: 2007/09/19_19:25:35 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:25:35 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:25:35 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:25:35 info: log_cib_diff: cib_update: Diff: --- 0.86.2 cibmon[739]: 2007/09/19_19:25:35 info: log_cib_diff: cib_update: Diff: +++ 0.87.1 cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: - cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: - cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:25:35 info: log_data_element: cib_update: + cib[741]: 2007/09/19_19:25:35 info: log_data_element: cib:diff: + cib[7098]: 2007/09/19_19:25:35 info: write_cib_contents: Wrote version 0.87.1 of the CIB to disk (digest: 6bbfeb4eead6697be033575b5c9021e4) tengine[2002]: 2007/09/19_19:25:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244339-59 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:36 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:36 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:36 notice: run_graph: Transition 80: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:36 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' crmd[745]: 2007/09/19_19:25:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:36 info: unpack_graph: Unpacked transition 81: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' tengine[2002]: 2007/09/19_19:25:36 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:36 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:36 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:36 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:36 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:36 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:36 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:36 info: process_pe_message: Transition 81: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-130.bz2 tengine[2002]: 2007/09/19_19:25:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244340-60 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:37 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:37 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:37 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:37 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:37 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:37 notice: run_graph: Transition 81: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:37 info: unpack_graph: Unpacked transition 82: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:37 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:37 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:37 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:37 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:37 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:37 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:37 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:37 info: process_pe_message: Transition 82: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-131.bz2 tengine[2002]: 2007/09/19_19:25:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244342-61 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:39 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:39 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:39 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:39 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:25:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:39 notice: run_graph: Transition 82: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:25:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:39 info: unpack_graph: Unpacked transition 83: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:39 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:39 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:39 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:39 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:39 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:39 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:39 info: process_pe_message: Transition 83: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-132.bz2 tengine[2002]: 2007/09/19_19:25:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244343-62 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:40 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:40 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:40 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:40 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:40 notice: run_graph: Transition 83: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:40 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:40 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:40 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[745]: 2007/09/19_19:25:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:40 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:40 info: unpack_graph: Unpacked transition 84: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:25:40 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:40 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:40 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:40 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:40 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:40 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:40 info: process_pe_message: Transition 84: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-133.bz2 tengine[2002]: 2007/09/19_19:25:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244344-63 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:41 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:41 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:41 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:41 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:41 notice: run_graph: Transition 84: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:41 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:25:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:41 info: unpack_graph: Unpacked transition 85: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:41 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:41 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:41 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:41 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:41 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:41 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:41 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:41 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:41 info: process_pe_message: Transition 85: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-134.bz2 tengine[2002]: 2007/09/19_19:25:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244346-64 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:43 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:43 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:43 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:43 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:43 notice: run_graph: Transition 85: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:25:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:43 info: unpack_graph: Unpacked transition 86: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:43 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:43 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:43 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:43 info: process_pe_message: Transition 86: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-135.bz2 tengine[2002]: 2007/09/19_19:25:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244347-65 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:44 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:44 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:44 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:44 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:44 notice: run_graph: Transition 86: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:44 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:25:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:25:44 info: unpack_graph: Unpacked transition 87: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:44 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:25:44 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:44 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:44 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:44 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:44 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:44 info: process_pe_message: Transition 87: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-136.bz2 tengine[2002]: 2007/09/19_19:25:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244348-66 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:45 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:45 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:45 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:45 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:45 notice: run_graph: Transition 87: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:25:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:45 info: unpack_graph: Unpacked transition 88: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:45 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:45 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:45 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:45 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:45 info: process_pe_message: Transition 88: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-137.bz2 tengine[2002]: 2007/09/19_19:25:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244350-67 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:46 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:46 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:46 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:46 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:46 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:46 notice: run_graph: Transition 88: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:46 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:46 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:25:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:46 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:46 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:46 info: unpack_graph: Unpacked transition 89: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:46 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:46 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:46 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:46 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:46 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:46 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:46 info: process_pe_message: Transition 89: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-138.bz2 tengine[2002]: 2007/09/19_19:25:48 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244351-68 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:48 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:48 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:48 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:48 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:48 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:48 notice: run_graph: Transition 89: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:25:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:48 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:48 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:48 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:48 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:48 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:48 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:48 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:25:48 info: unpack_graph: Unpacked transition 90: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:48 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:25:48 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:48 info: process_pe_message: Transition 90: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-139.bz2 tengine[2002]: 2007/09/19_19:25:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244353-69 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:49 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:49 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:49 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:49 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:49 notice: run_graph: Transition 90: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:49 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:25:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:49 info: unpack_graph: Unpacked transition 91: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:49 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:49 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:49 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:49 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:49 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:49 info: process_pe_message: Transition 91: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-140.bz2 tengine[2002]: 2007/09/19_19:25:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244354-70 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:50 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:50 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:50 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:50 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:50 notice: run_graph: Transition 91: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:50 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:50 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:50 info: unpack_graph: Unpacked transition 92: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:25:50 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:50 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:50 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:50 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:50 info: process_pe_message: Transition 92: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-141.bz2 tengine[2002]: 2007/09/19_19:25:51 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244355-71 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:51 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:51 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:51 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:51 notice: run_graph: Transition 92: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:25:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:25:51 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:25:51 info: unpack_graph: Unpacked transition 93: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:25:51 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:51 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:51 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:51 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:51 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:51 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:51 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:51 info: process_pe_message: Transition 93: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-142.bz2 tengine[2002]: 2007/09/19_19:25:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244356-72 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:53 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:53 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:53 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:53 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:53 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:53 notice: run_graph: Transition 93: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:25:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:25:53 info: unpack_graph: Unpacked transition 94: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:25:53 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:53 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:53 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:53 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:53 info: process_pe_message: Transition 94: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-143.bz2 tengine[2002]: 2007/09/19_19:25:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244358-73 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:54 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:25:54 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:54 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:54 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:54 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:54 notice: run_graph: Transition 94: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:54 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:54 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:25:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:54 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:54 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:25:54 info: unpack_graph: Unpacked transition 95: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:25:54 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:54 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:54 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:54 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:54 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:54 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:54 info: process_pe_message: Transition 95: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-144.bz2 cib[741]: 2007/09/19_19:25:54 info: cib_stats: Processed 112 operations (11071.00us average, 0% utilization) in the last 10min tengine[2002]: 2007/09/19_19:25:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244359-74 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:55 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:55 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:55 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:55 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:55 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:55 notice: run_graph: Transition 95: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:25:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:55 info: unpack_graph: Unpacked transition 96: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:55 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:55 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:55 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:55 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:55 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:55 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:55 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:55 info: process_pe_message: Transition 96: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-145.bz2 tengine[2002]: 2007/09/19_19:25:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244360-75 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:56 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:56 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:56 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:56 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:56 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:56 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:56 notice: run_graph: Transition 96: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:25:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:25:56 info: unpack_graph: Unpacked transition 97: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:25:56 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:56 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:56 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:56 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:56 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:56 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:56 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:56 info: process_pe_message: Transition 97: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-146.bz2 tengine[2002]: 2007/09/19_19:25:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244361-76 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:25:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:58 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:25:58 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:58 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:58 notice: run_graph: Transition 97: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:58 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:25:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:58 info: unpack_graph: Unpacked transition 98: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:58 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:58 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:58 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:58 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:58 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:58 info: process_pe_message: Transition 98: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-147.bz2 tengine[2002]: 2007/09/19_19:25:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244363-77 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:59 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:25:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:25:59 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:25:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:25:59 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:59 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:25:59 notice: run_graph: Transition 98: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:25:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:25:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:25:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:25:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:25:59 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:25:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:25:59 info: unpack_graph: Unpacked transition 99: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:25:59 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:59 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:25:59 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:59 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:25:59 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:25:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:25:59 info: process_pe_message: Transition 99: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-148.bz2 tengine[2002]: 2007/09/19_19:26:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244364-78 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:00 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:00 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:00 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:00 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:00 notice: run_graph: Transition 99: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:00 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:00 info: unpack_graph: Unpacked transition 100: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:00 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:00 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:00 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:00 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:00 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:00 info: process_pe_message: Transition 100: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-149.bz2 tengine[2002]: 2007/09/19_19:26:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244365-79 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:01 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:01 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:01 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:01 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:01 notice: run_graph: Transition 100: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:26:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:01 info: unpack_graph: Unpacked transition 101: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:01 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:01 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:01 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:01 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:01 info: process_pe_message: Transition 101: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-150.bz2 tengine[2002]: 2007/09/19_19:26:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244366-80 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:03 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:03 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:03 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:03 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:03 notice: run_graph: Transition 101: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:26:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:03 info: unpack_graph: Unpacked transition 102: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:03 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:03 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:03 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:03 info: process_pe_message: Transition 102: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-151.bz2 tengine[2002]: 2007/09/19_19:26:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244367-81 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:04 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:04 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:04 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:04 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:04 notice: run_graph: Transition 102: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:04 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:04 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:04 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:04 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:04 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:26:04 info: unpack_graph: Unpacked transition 103: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:26:04 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:04 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:04 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:04 info: process_pe_message: Transition 103: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-152.bz2 tengine[2002]: 2007/09/19_19:26:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244369-82 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:05 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:05 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:05 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:05 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:05 notice: run_graph: Transition 103: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:05 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:26:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:05 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:05 info: unpack_graph: Unpacked transition 104: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:05 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:05 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:05 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:05 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:05 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:05 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:05 info: process_pe_message: Transition 104: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-153.bz2 tengine[2002]: 2007/09/19_19:26:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244370-83 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:06 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:06 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:06 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:06 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:06 notice: run_graph: Transition 104: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:06 info: unpack_graph: Unpacked transition 105: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:06 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:06 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:06 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:06 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:06 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:06 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:06 info: process_pe_message: Transition 105: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-154.bz2 tengine[2002]: 2007/09/19_19:26:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244371-84 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:08 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:08 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:08 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:08 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:08 notice: run_graph: Transition 105: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:26:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:08 info: unpack_graph: Unpacked transition 106: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:08 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:08 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:08 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:08 info: process_pe_message: Transition 106: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-155.bz2 tengine[2002]: 2007/09/19_19:26:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244373-85 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:09 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:09 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:09 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:09 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:09 notice: run_graph: Transition 106: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:26:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:09 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:09 info: unpack_graph: Unpacked transition 107: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:09 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:09 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:09 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:09 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:09 info: process_pe_message: Transition 107: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-156.bz2 tengine[2002]: 2007/09/19_19:26:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244373-86 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:10 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:10 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:10 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:10 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:10 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:10 notice: run_graph: Transition 107: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:26:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:26:10 info: unpack_graph: Unpacked transition 108: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:26:10 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:10 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:10 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:10 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:10 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:10 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:10 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:10 info: process_pe_message: Transition 108: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-157.bz2 tengine[2002]: 2007/09/19_19:26:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244375-87 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:11 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:11 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:11 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:11 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:26:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:11 notice: run_graph: Transition 108: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:26:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:11 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:11 info: unpack_graph: Unpacked transition 109: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:11 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:11 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:11 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:11 info: process_pe_message: Transition 109: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-158.bz2 tengine[2002]: 2007/09/19_19:26:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244376-88 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:12 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:12 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:12 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:12 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:12 notice: run_graph: Transition 109: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:12 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:12 info: unpack_graph: Unpacked transition 110: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:12 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:12 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:12 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:12 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:12 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:12 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:12 info: process_pe_message: Transition 110: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-159.bz2 tengine[2002]: 2007/09/19_19:26:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244377-89 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:13 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:13 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:13 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:13 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:13 notice: run_graph: Transition 110: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:13 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:13 info: unpack_graph: Unpacked transition 111: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:13 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:13 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:13 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:13 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:13 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:13 info: process_pe_message: Transition 111: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-160.bz2 tengine[2002]: 2007/09/19_19:26:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244378-90 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:15 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:15 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:15 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:15 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:15 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:15 notice: run_graph: Transition 111: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:26:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:15 info: unpack_graph: Unpacked transition 112: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:15 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:15 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:15 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:15 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:15 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:15 info: process_pe_message: Transition 112: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-161.bz2 tengine[2002]: 2007/09/19_19:26:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244379-91 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:16 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:16 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:16 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:16 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:16 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:16 notice: run_graph: Transition 112: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:16 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:26:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:16 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:16 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:26:16 info: unpack_graph: Unpacked transition 113: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:26:16 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:16 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:16 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:16 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:16 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:16 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:16 info: process_pe_message: Transition 113: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-162.bz2 tengine[2002]: 2007/09/19_19:26:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244381-92 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:17 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:17 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:17 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:17 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:17 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:17 notice: run_graph: Transition 113: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:17 info: unpack_graph: Unpacked transition 114: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:17 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:17 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:17 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:17 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:17 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:17 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:17 info: process_pe_message: Transition 114: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-163.bz2 tengine[2002]: 2007/09/19_19:26:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244382-93 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:18 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:18 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:18 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:18 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:18 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:18 notice: run_graph: Transition 114: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:26:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:18 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:18 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:18 info: unpack_graph: Unpacked transition 115: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:18 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:18 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:18 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:18 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:18 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:18 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:18 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:18 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:18 info: process_pe_message: Transition 115: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-164.bz2 tengine[2002]: 2007/09/19_19:26:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244383-94 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:19 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:19 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:19 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:19 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:19 notice: run_graph: Transition 115: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:26:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:19 info: unpack_graph: Unpacked transition 116: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:19 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:19 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:19 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:19 info: process_pe_message: Transition 116: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-165.bz2 tengine[2002]: 2007/09/19_19:26:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244384-95 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:20 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:20 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:20 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:20 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:20 notice: run_graph: Transition 116: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:26:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:20 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:20 info: unpack_graph: Unpacked transition 117: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:20 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:20 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:20 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:20 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:20 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:20 info: process_pe_message: Transition 117: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-166.bz2 tengine[2002]: 2007/09/19_19:26:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244385-96 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:22 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:22 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:22 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:22 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:22 notice: run_graph: Transition 117: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:26:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:26:22 info: unpack_graph: Unpacked transition 118: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:22 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:22 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:22 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:22 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:22 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:22 info: process_pe_message: Transition 118: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-167.bz2 tengine[2002]: 2007/09/19_19:26:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244387-97 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:23 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:23 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:23 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:23 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:23 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:23 notice: run_graph: Transition 118: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[745]: 2007/09/19_19:26:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:26:23 info: unpack_graph: Unpacked transition 119: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:23 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:23 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:23 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:23 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:23 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:23 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:23 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:23 info: process_pe_message: Transition 119: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-168.bz2 tengine[2002]: 2007/09/19_19:26:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244387-98 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:24 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:24 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:24 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:24 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:26:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:24 notice: run_graph: Transition 119: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:24 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:26:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:24 info: unpack_graph: Unpacked transition 120: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:24 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:24 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:24 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:24 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:24 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:24 info: process_pe_message: Transition 120: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-169.bz2 tengine[2002]: 2007/09/19_19:26:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244389-99 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:25 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:25 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:25 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:25 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:25 notice: run_graph: Transition 120: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:25 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:26:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:25 info: unpack_graph: Unpacked transition 121: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:26:25 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:25 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:25 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:25 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:25 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:25 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:25 info: process_pe_message: Transition 121: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-170.bz2 tengine[2002]: 2007/09/19_19:26:26 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244390-100 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:26 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:26 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:26 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:26 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:26 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:26 notice: run_graph: Transition 121: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:26:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:26:26 info: unpack_graph: Unpacked transition 122: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:26 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:26 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:26 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:26 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:26 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:26 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:26 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:26 info: process_pe_message: Transition 122: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-171.bz2 tengine[2002]: 2007/09/19_19:26:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244391-101 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:28 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:28 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:28 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:28 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:28 notice: run_graph: Transition 122: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:28 info: unpack_graph: Unpacked transition 123: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:28 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:28 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:28 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:28 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:28 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:28 info: process_pe_message: Transition 123: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-172.bz2 tengine[2002]: 2007/09/19_19:26:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244392-102 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:29 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:29 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:29 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:29 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:29 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:29 notice: run_graph: Transition 123: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:29 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:26:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:29 info: unpack_graph: Unpacked transition 124: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:29 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:29 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:29 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:29 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:29 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:29 info: process_pe_message: Transition 124: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-173.bz2 tengine[2002]: 2007/09/19_19:26:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244393-103 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:30 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:30 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:30 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:30 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:30 notice: run_graph: Transition 124: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:30 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:26:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:30 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:30 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:30 info: unpack_graph: Unpacked transition 125: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:30 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:30 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:30 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:30 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:30 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:30 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:30 info: process_pe_message: Transition 125: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-174.bz2 tengine[2002]: 2007/09/19_19:26:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244395-104 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:31 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:31 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:31 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:31 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:31 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:31 notice: run_graph: Transition 125: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:26:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:32 info: unpack_graph: Unpacked transition 126: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:32 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:31 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:31 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:31 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:32 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:32 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:32 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:32 info: process_pe_message: Transition 126: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-175.bz2 tengine[2002]: 2007/09/19_19:26:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244396-105 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:33 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:33 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:33 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:33 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:33 notice: run_graph: Transition 126: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:26:33 info: unpack_graph: Unpacked transition 127: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:33 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:33 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:33 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:33 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:33 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:33 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:33 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:33 info: process_pe_message: Transition 127: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-176.bz2 tengine[2002]: 2007/09/19_19:26:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244397-106 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:34 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:34 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:34 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:34 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:34 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:34 notice: run_graph: Transition 127: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:34 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:34 info: unpack_graph: Unpacked transition 128: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:34 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:34 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:34 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:34 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:34 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:34 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:34 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:34 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:34 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:34 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:34 info: process_pe_message: Transition 128: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-177.bz2 tengine[2002]: 2007/09/19_19:26:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244398-107 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:35 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:35 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:35 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:35 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:26:35 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:35 notice: run_graph: Transition 128: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:26:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:35 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:35 info: unpack_graph: Unpacked transition 129: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:35 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:35 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:35 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:35 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:35 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:35 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:35 info: process_pe_message: Transition 129: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-178.bz2 tengine[2002]: 2007/09/19_19:26:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244400-108 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:36 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:36 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:36 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:36 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:36 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:36 notice: run_graph: Transition 129: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:37 info: unpack_graph: Unpacked transition 130: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:37 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:37 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:37 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:37 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:37 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:37 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:37 info: process_pe_message: Transition 130: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-179.bz2 tengine[2002]: 2007/09/19_19:26:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244401-109 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:38 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:38 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:38 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:38 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:38 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:38 notice: run_graph: Transition 130: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[745]: 2007/09/19_19:26:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:26:38 info: unpack_graph: Unpacked transition 131: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:38 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:38 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:38 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:38 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:38 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:38 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:38 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:38 info: process_pe_message: Transition 131: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-180.bz2 tengine[2002]: 2007/09/19_19:26:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244402-110 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:39 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:39 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:39 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:39 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:39 notice: run_graph: Transition 131: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:39 info: unpack_graph: Unpacked transition 132: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:39 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:39 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:39 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:39 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:39 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:39 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:39 info: process_pe_message: Transition 132: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-181.bz2 tengine[2002]: 2007/09/19_19:26:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244403-111 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:40 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:40 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:40 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:40 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:40 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:40 notice: run_graph: Transition 132: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:26:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:40 info: unpack_graph: Unpacked transition 133: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:26:40 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:40 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:40 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:40 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:40 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:40 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:40 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:40 info: process_pe_message: Transition 133: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-182.bz2 tengine[2002]: 2007/09/19_19:26:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244405-112 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:42 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:42 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:42 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:42 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:42 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:42 notice: run_graph: Transition 133: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:26:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:42 info: unpack_graph: Unpacked transition 134: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:42 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:42 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:42 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:42 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:42 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:42 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:42 info: process_pe_message: Transition 134: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-183.bz2 tengine[2002]: 2007/09/19_19:26:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244406-113 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:43 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:43 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:43 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:43 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:43 notice: run_graph: Transition 134: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:26:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:43 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:43 info: unpack_graph: Unpacked transition 135: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:43 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:43 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:43 info: process_pe_message: Transition 135: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-184.bz2 tengine[2002]: 2007/09/19_19:26:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244407-114 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:44 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:44 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:44 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:44 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:44 notice: run_graph: Transition 135: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:44 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:26:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:44 info: unpack_graph: Unpacked transition 136: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:44 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:44 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:44 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:44 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:44 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:44 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:44 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:44 info: process_pe_message: Transition 136: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-185.bz2 tengine[2002]: 2007/09/19_19:26:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244408-115 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:45 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:45 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:45 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:45 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:45 notice: run_graph: Transition 136: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[745]: 2007/09/19_19:26:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:26:45 info: unpack_graph: Unpacked transition 137: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:26:45 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:45 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:45 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:45 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:45 info: process_pe_message: Transition 137: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-186.bz2 tengine[2002]: 2007/09/19_19:26:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244410-116 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:47 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:47 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:47 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:47 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:47 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:47 notice: run_graph: Transition 137: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:47 info: unpack_graph: Unpacked transition 138: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:47 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:47 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:47 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:47 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:47 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:47 info: process_pe_message: Transition 138: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-187.bz2 tengine[2002]: 2007/09/19_19:26:48 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244411-117 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:48 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:48 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:48 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:48 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:48 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:26:48 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:48 notice: run_graph: Transition 138: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:48 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:48 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:48 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:26:48 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:48 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:48 info: unpack_graph: Unpacked transition 139: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:48 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:48 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:48 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:48 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:48 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:48 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:48 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:48 info: process_pe_message: Transition 139: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-188.bz2 tengine[2002]: 2007/09/19_19:26:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244412-118 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:49 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:49 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:49 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:49 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:49 notice: run_graph: Transition 139: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:49 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:26:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:26:49 info: unpack_graph: Unpacked transition 140: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:49 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:26:49 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:49 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:49 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:49 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:49 info: process_pe_message: Transition 140: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-189.bz2 tengine[2002]: 2007/09/19_19:26:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244413-119 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:50 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:50 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:50 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:50 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:50 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:50 notice: run_graph: Transition 140: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:26:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:50 info: unpack_graph: Unpacked transition 141: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:50 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:50 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:50 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:50 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:50 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:50 info: process_pe_message: Transition 141: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-190.bz2 tengine[2002]: 2007/09/19_19:26:51 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244414-120 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:51 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:51 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:51 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:51 notice: run_graph: Transition 141: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:51 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:51 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:26:51 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:51 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:51 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:51 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:51 info: unpack_graph: Unpacked transition 142: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:51 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:51 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:51 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:51 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:51 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:51 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:51 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:51 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:51 info: process_pe_message: Transition 142: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-191.bz2 tengine[2002]: 2007/09/19_19:26:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244416-121 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:52 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:52 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:52 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:52 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:52 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:52 notice: run_graph: Transition 142: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:26:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:26:52 info: unpack_graph: Unpacked transition 143: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:52 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:52 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:52 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:52 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:52 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:52 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:52 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:52 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:52 info: process_pe_message: Transition 143: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-192.bz2 tengine[2002]: 2007/09/19_19:26:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244416-122 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:53 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:53 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:53 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:53 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:26:53 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:53 notice: run_graph: Transition 143: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:53 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:26:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:53 info: unpack_graph: Unpacked transition 144: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:26:53 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:53 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:53 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:53 info: process_pe_message: Transition 144: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-193.bz2 tengine[2002]: 2007/09/19_19:26:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244418-123 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:26:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:54 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:54 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:54 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:54 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:54 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:54 notice: run_graph: Transition 144: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:26:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:54 info: unpack_graph: Unpacked transition 145: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:26:54 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:54 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:54 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:54 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:54 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:54 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:54 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:54 info: process_pe_message: Transition 145: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-194.bz2 tengine[2002]: 2007/09/19_19:26:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244419-124 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:56 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:56 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:56 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:56 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:56 notice: run_graph: Transition 145: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:56 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:56 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:26:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:56 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:56 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:56 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:56 info: unpack_graph: Unpacked transition 146: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:26:56 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:56 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:56 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:56 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:56 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:56 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:56 info: process_pe_message: Transition 146: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-195.bz2 tengine[2002]: 2007/09/19_19:26:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244420-125 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:57 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:26:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:26:57 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:26:57 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:26:57 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:57 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:57 notice: run_graph: Transition 146: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:26:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:26:57 info: unpack_graph: Unpacked transition 147: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:26:57 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:57 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:57 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:57 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:57 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:57 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:57 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:57 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:57 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:57 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:57 info: process_pe_message: Transition 147: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-196.bz2 tengine[2002]: 2007/09/19_19:26:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244421-126 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:58 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:58 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:58 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:58 notice: run_graph: Transition 147: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:58 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:26:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:58 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:58 info: unpack_graph: Unpacked transition 148: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:58 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:58 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:58 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:58 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:58 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:58 info: process_pe_message: Transition 148: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-197.bz2 tengine[2002]: 2007/09/19_19:26:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244422-127 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:59 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:26:59 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:26:59 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:26:59 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:26:59 notice: run_graph: Transition 148: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:26:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:26:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' crmd[745]: 2007/09/19_19:26:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:26:59 info: unpack_graph: Unpacked transition 149: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:26:59 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:26:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:26:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:26:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:26:59 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:26:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:26:59 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:26:59 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:26:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:26:59 info: process_pe_message: Transition 149: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-198.bz2 tengine[2002]: 2007/09/19_19:27:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244424-128 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:01 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:01 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:01 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:01 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:01 notice: run_graph: Transition 149: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:27:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:01 info: unpack_graph: Unpacked transition 150: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:27:01 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:01 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:01 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:01 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:01 info: process_pe_message: Transition 150: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-199.bz2 tengine[2002]: 2007/09/19_19:27:02 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244425-129 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:02 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:02 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:02 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:02 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:02 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:02 notice: run_graph: Transition 150: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' crmd[745]: 2007/09/19_19:27:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:27:02 info: unpack_graph: Unpacked transition 151: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:27:02 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:02 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:02 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:02 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:02 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:02 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:02 info: process_pe_message: Transition 151: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-200.bz2 tengine[2002]: 2007/09/19_19:27:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244426-130 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:03 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:03 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:03 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:03 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:03 notice: run_graph: Transition 151: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:27:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:27:03 info: unpack_graph: Unpacked transition 152: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:27:03 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:03 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:03 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:03 info: process_pe_message: Transition 152: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-201.bz2 tengine[2002]: 2007/09/19_19:27:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244428-131 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:04 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:04 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:04 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:04 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:04 notice: run_graph: Transition 152: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:04 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:04 info: unpack_graph: Unpacked transition 153: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:04 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:04 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:04 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:04 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:04 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:04 info: process_pe_message: Transition 153: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-202.bz2 tengine[2002]: 2007/09/19_19:27:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244429-132 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:06 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:06 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:06 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:06 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:06 notice: run_graph: Transition 153: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' crmd[745]: 2007/09/19_19:27:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:27:06 info: unpack_graph: Unpacked transition 154: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:27:06 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:06 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:06 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:06 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:06 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:06 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:06 info: process_pe_message: Transition 154: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-203.bz2 tengine[2002]: 2007/09/19_19:27:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244430-133 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:07 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:07 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:07 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:07 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:07 notice: run_graph: Transition 154: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:27:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:27:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:27:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[2002]: 2007/09/19_19:27:07 info: unpack_graph: Unpacked transition 155: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:27:07 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:07 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:07 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:07 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:07 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:07 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:07 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:07 info: process_pe_message: Transition 155: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-204.bz2 tengine[2002]: 2007/09/19_19:27:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244431-134 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:08 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:08 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:08 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:08 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:08 notice: run_graph: Transition 155: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:08 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:27:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:08 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:08 info: unpack_graph: Unpacked transition 156: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:08 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:08 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:08 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:08 info: process_pe_message: Transition 156: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-205.bz2 tengine[2002]: 2007/09/19_19:27:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244433-135 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:09 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:09 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:09 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:09 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:09 notice: run_graph: Transition 156: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:27:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:27:09 info: unpack_graph: Unpacked transition 157: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:09 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:09 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:09 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:09 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:09 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:09 info: process_pe_message: Transition 157: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-206.bz2 tengine[2002]: 2007/09/19_19:27:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244434-136 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:11 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:11 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:11 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:11 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:27:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:11 notice: run_graph: Transition 157: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:27:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:27:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[2002]: 2007/09/19_19:27:11 info: unpack_graph: Unpacked transition 158: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:27:11 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:11 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:11 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:11 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:11 info: process_pe_message: Transition 158: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-207.bz2 tengine[2002]: 2007/09/19_19:27:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244436-137 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:13 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:13 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:13 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:13 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:13 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:13 notice: run_graph: Transition 158: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:13 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:27:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:13 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:13 info: unpack_graph: Unpacked transition 159: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:13 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:13 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:13 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:13 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:13 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:13 info: process_pe_message: Transition 159: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-208.bz2 tengine[2002]: 2007/09/19_19:27:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244437-138 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:14 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:14 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:14 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:14 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:14 notice: run_graph: Transition 159: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) crmd[745]: 2007/09/19_19:27:14 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:27:14 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:27:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' tengine[2002]: 2007/09/19_19:27:14 info: unpack_graph: Unpacked transition 160: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' tengine[2002]: 2007/09/19_19:27:14 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:14 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:14 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:14 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:14 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:14 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:14 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:14 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:14 info: process_pe_message: Transition 160: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-209.bz2 tengine[2002]: 2007/09/19_19:27:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244439-139 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:16 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:16 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:16 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:16 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:16 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:16 notice: run_graph: Transition 160: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' crmd[745]: 2007/09/19_19:27:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' tengine[2002]: 2007/09/19_19:27:16 info: unpack_graph: Unpacked transition 161: 4 actions in 4 synapses pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' tengine[2002]: 2007/09/19_19:27:16 info: send_rsc_command: Initiating action 18: mysql_start_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:16 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:16 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:16 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:16 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:16 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:16 info: process_pe_message: Transition 161: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-210.bz2 tengine[2002]: 2007/09/19_19:27:16 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e tengine[2002]: 2007/09/19_19:27:16 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[2002]: 2007/09/19_19:27:16 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:16 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:27:16 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:27:16 info: log_cib_diff: cib_modify: Diff: --- 0.87.1 cibmon[739]: 2007/09/19_19:27:16 info: log_cib_diff: cib_modify: Diff: +++ 0.87.2 cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:27:16 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[2002]: 2007/09/19_19:27:16 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:27:16 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:27:16 info: log_cib_diff: cib_modify: Diff: --- 0.87.2 cibmon[739]: 2007/09/19_19:27:16 info: log_cib_diff: cib_modify: Diff: +++ 0.87.3 cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:16 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:27:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244440-141 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:17 info: match_graph_event: Action mysql_start_0 (18) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:17 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:17 notice: run_graph: Transition 161: (Complete=1, Pending=0, Fired=0, Skipped=3, Incomplete=0) pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:17 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:17 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:17 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:17 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:17 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:17 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:17 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:17 info: process_pe_message: Transition 162: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-211.bz2 tengine[2002]: 2007/09/19_19:27:17 info: unpack_graph: Unpacked transition 162: 23 actions in 23 synapses tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 18: share-drbd_monitor_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 19: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 20: share-FS_monitor_0 on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=18:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 21: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 22: mysql_monitor_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 23: msg_first_monitor_0 on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 24: msg_last_monitor_0 on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=19:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:17 info: send_rsc_command: Initiating action 25: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=20:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=21:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=22:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=23:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=24:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=25:162:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:27:17 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=61, rc=7) complete cibmon[739]: 2007/09/19_19:27:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:17 info: log_cib_diff: cib_update: Diff: --- 0.87.3 cibmon[739]: 2007/09/19_19:27:17 info: log_cib_diff: cib_update: Diff: +++ 0.87.4 cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:27:17 info: match_graph_event: Action share-drbd_monitor_0 (18) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:17 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:27:18 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=62, rc=7) complete cibmon[739]: 2007/09/19_19:27:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: --- 0.87.4 cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: +++ 0.87.5 cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:27:18 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=68, rc=7) complete cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action share-drbdlinks_monitor_0 (19) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: --- 0.87.5 cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: +++ 0.87.6 cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (25) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:27:18 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=64, rc=0) complete cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: --- 0.87.6 cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: +++ 0.87.7 cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action vmstat-mon_monitor_0 (21) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:27:18 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=63, rc=7) complete cibmon[739]: 2007/09/19_19:27:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action share-FS_monitor_0 (20) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: --- 0.87.7 cibmon[739]: 2007/09/19_19:27:18 info: log_cib_diff: cib_update: Diff: +++ 0.87.8 cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:18 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:27:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-142 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:18 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:18 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-143 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:18 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:18 info: process_lrm_event: LRM operation mysql_monitor_0 (call=65, rc=7) complete crmd[745]: 2007/09/19_19:27:19 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=66, rc=7) complete cibmon[739]: 2007/09/19_19:27:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: --- 0.87.8 cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: +++ 0.87.9 cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action mysql_monitor_0 (22) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: --- 0.87.9 cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: +++ 0.87.10 cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action msg_first_monitor_0 (23) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:27:19 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=67, rc=7) complete cibmon[739]: 2007/09/19_19:27:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action msg_last_monitor_0 (24) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: --- 0.87.10 tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 17: probe_complete on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_update: Diff: +++ 0.87.11 cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:27:19 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed tengine[2002]: 2007/09/19_19:27:19 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_modify: Diff: --- 0.87.11 tengine[2002]: 2007/09/19_19:27:19 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:27:19 info: log_cib_diff: cib_modify: Diff: +++ 0.87.12 tengine[2002]: 2007/09/19_19:27:19 info: update_abort_priority: 'Event failed' abort superceeded cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - tengine[2002]: 2007/09/19_19:27:19 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:27:19 info: log_data_element: cib_modify: + tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-144 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-145 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-146 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-147 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-148 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244442-149 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:19 notice: run_graph: Transition 162: (Complete=17, Pending=0, Fired=0, Skipped=5, Incomplete=1) crmd[745]: 2007/09/19_19:27:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:27:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 notice: StartRsc: host-2.awale.qc.ca Start mysql crmd[745]: 2007/09/19_19:27:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:19 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:19 info: process_pe_message: Transition 163: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-212.bz2 tengine[2002]: 2007/09/19_19:27:19 info: unpack_graph: Unpacked transition 163: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:19 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-150 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-151 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:20 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-152 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-153 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-154 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-155 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-156 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244443-157 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:20 notice: run_graph: Transition 163: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:20 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:20 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:20 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:20 info: unpack_graph: Unpacked transition 164: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:20 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:20 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:20 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:20 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:20 info: process_pe_message: Transition 164: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-213.bz2 tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244444-158 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244444-159 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244444-160 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-161 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-162 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:21 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-163 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-164 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-165 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:21 notice: run_graph: Transition 164: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:27:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:21 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: unpack_graph: Unpacked transition 165: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:21 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:21 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:21 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:21 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:21 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:21 info: process_pe_message: Transition 165: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-214.bz2 tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244445-166 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:22 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-167 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-168 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-169 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-170 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-171 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-172 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244446-173 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:22 notice: run_graph: Transition 165: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:27:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: unpack_graph: Unpacked transition 166: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:22 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:22 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:22 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:22 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:22 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:22 info: process_pe_message: Transition 166: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-215.bz2 tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-174 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:24 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-175 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:24 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-176 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-177 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-178 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-179 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-180 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244447-181 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:24 notice: run_graph: Transition 166: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:24 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:24 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:24 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: unpack_graph: Unpacked transition 167: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:24 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:24 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:24 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:24 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:24 info: process_pe_message: Transition 167: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-216.bz2 tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-182 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:25 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-183 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-184 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-185 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-186 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-187 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-188 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-189 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:25 notice: run_graph: Transition 167: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:25 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:25 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:25 info: unpack_graph: Unpacked transition 168: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: process_pe_message: Transition 168: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-217.bz2 tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-190 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:25 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-191 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-192 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-193 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-194 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-195 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-196 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244449-197 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:25 notice: run_graph: Transition 168: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:25 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: unpack_graph: Unpacked transition 169: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:25 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:25 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:25 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:25 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:25 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:25 info: process_pe_message: Transition 169: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-218.bz2 tengine[2002]: 2007/09/19_19:27:26 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-198 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:26 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:26 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:26 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-199 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-200 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:27 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-201 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:27 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-202 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-203 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-204 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244450-205 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:27 notice: run_graph: Transition 169: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:27 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:27:27 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:27 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:27 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:27 info: unpack_graph: Unpacked transition 170: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:27 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:27 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:27 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:27 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:27 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:27 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:27 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:27 info: process_pe_message: Transition 170: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-219.bz2 tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-206 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:28 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-207 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-208 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-209 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-210 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-211 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-212 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244452-213 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:28 notice: run_graph: Transition 170: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:28 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:28 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) crmd[745]: 2007/09/19_19:27:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:28 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:28 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:28 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:28 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:28 info: unpack_graph: Unpacked transition 171: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:28 info: process_pe_message: Transition 171: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-220.bz2 tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:28 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-214 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:30 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-215 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-216 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-217 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-218 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:30 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-219 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-220 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244453-221 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:30 notice: run_graph: Transition 171: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:30 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:30 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:30 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: unpack_graph: Unpacked transition 172: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:30 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:30 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:30 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:30 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:30 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:30 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:30 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:30 info: process_pe_message: Transition 172: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-221.bz2 tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-222 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:31 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:31 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:31 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-223 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-224 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-225 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-226 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-227 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-228 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244455-229 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:31 notice: run_graph: Transition 172: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:31 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: unpack_graph: Unpacked transition 173: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:31 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:31 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:31 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:31 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:31 info: process_pe_message: Transition 173: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-222.bz2 tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-230 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:32 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-231 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-232 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-233 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:32 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-234 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-235 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-236 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244456-237 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:32 notice: run_graph: Transition 173: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:32 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:32 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:32 info: unpack_graph: Unpacked transition 174: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:32 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:32 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:32 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:32 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:32 info: process_pe_message: Transition 174: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-223.bz2 tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-238 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:33 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-239 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-240 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-241 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-242 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-243 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-244 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244457-245 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:33 notice: run_graph: Transition 174: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:33 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:33 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:33 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:33 info: unpack_graph: Unpacked transition 175: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:33 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:33 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:33 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:33 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:33 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:33 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:33 info: process_pe_message: Transition 175: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-224.bz2 tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-246 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:34 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-247 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:34 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-248 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-249 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-250 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-251 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-252 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244458-253 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:34 notice: run_graph: Transition 175: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:34 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:34 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:27:34 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:34 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:34 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:34 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:34 info: unpack_graph: Unpacked transition 176: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:34 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:34 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:34 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:34 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:34 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:34 info: process_pe_message: Transition 176: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-225.bz2 tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-254 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:36 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-255 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-256 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-257 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-258 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:36 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-259 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-260 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244459-261 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:36 notice: run_graph: Transition 176: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:36 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:36 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[745]: 2007/09/19_19:27:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:36 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:36 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:36 info: unpack_graph: Unpacked transition 177: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:36 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:36 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:36 info: process_pe_message: Transition 177: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-226.bz2 tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-262 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:37 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-263 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-264 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:37 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-265 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-266 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-267 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-268 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244461-269 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:37 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:37 notice: run_graph: Transition 177: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:37 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:37 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:37 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:37 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:37 info: unpack_graph: Unpacked transition 178: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:37 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:37 info: process_pe_message: Transition 178: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-227.bz2 tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-270 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:38 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-271 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-272 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-273 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-274 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-275 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:38 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-276 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244462-277 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:38 notice: run_graph: Transition 178: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:38 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:38 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:38 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:38 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: unpack_graph: Unpacked transition 179: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:38 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:38 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:38 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:38 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:38 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:38 info: process_pe_message: Transition 179: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-228.bz2 tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-278 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:39 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-279 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-280 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-281 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-282 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-283 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-284 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244463-285 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:39 notice: run_graph: Transition 179: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:39 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:27:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:39 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: unpack_graph: Unpacked transition 180: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:39 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:39 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:39 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:39 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:39 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:39 info: process_pe_message: Transition 180: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-229.bz2 tengine[2002]: 2007/09/19_19:27:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-286 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:40 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:40 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:40 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-287 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:41 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-288 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-289 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-290 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-291 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-292 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244464-293 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:41 notice: run_graph: Transition 180: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:41 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:41 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: unpack_graph: Unpacked transition 181: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:41 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:41 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:41 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:41 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:41 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:41 info: process_pe_message: Transition 181: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-230.bz2 tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-294 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:42 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-295 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:42 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-296 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-297 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-298 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-299 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-300 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244466-301 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:42 notice: run_graph: Transition 181: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:42 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:42 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:42 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: unpack_graph: Unpacked transition 182: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:42 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:42 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:42 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:42 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:42 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:42 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:42 info: process_pe_message: Transition 182: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-231.bz2 tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-302 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:43 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-303 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-304 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-305 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-306 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-307 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-308 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244467-309 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:43 notice: run_graph: Transition 182: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:43 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:43 info: unpack_graph: Unpacked transition 183: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:43 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:43 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:43 info: process_pe_message: Transition 183: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-232.bz2 tengine[2002]: 2007/09/19_19:27:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-310 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:44 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:44 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:44 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-311 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-312 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-313 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-314 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-315 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-316 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244468-317 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:45 notice: run_graph: Transition 183: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:45 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[745]: 2007/09/19_19:27:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:45 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:45 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:45 info: unpack_graph: Unpacked transition 184: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:45 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:45 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:45 info: process_pe_message: Transition 184: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-233.bz2 tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-318 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:46 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-319 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-320 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:46 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-321 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-322 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-323 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-324 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244470-325 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:46 notice: run_graph: Transition 184: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:46 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:46 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:46 info: unpack_graph: Unpacked transition 185: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:46 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:46 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:46 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:46 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:46 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:46 info: process_pe_message: Transition 185: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-234.bz2 tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-326 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:47 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-327 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-328 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-329 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:47 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-330 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-331 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-332 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244471-333 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:47 notice: run_graph: Transition 185: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:27:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:47 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:47 info: unpack_graph: Unpacked transition 186: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:47 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:47 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:47 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:47 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:47 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:47 info: process_pe_message: Transition 186: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-235.bz2 tengine[2002]: 2007/09/19_19:27:48 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-334 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:48 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:48 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:48 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-335 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-336 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-337 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:49 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-338 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-339 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-340 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244472-341 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:49 notice: run_graph: Transition 186: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:49 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:49 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: unpack_graph: Unpacked transition 187: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:49 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:49 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:49 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:49 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:49 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:49 info: process_pe_message: Transition 187: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-236.bz2 tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-342 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:50 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-343 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-344 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:50 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-345 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-346 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-347 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-348 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244474-349 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:50 notice: run_graph: Transition 187: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:50 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:50 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:50 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: unpack_graph: Unpacked transition 188: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:50 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:50 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:50 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:50 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:50 info: process_pe_message: Transition 188: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-237.bz2 tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-350 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:52 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-351 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-352 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-353 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-354 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-355 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:52 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-356 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244475-357 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:52 notice: run_graph: Transition 188: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:52 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:52 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:52 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:52 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:52 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:52 info: unpack_graph: Unpacked transition 189: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:52 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:52 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:52 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:52 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:52 info: process_pe_message: Transition 189: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-238.bz2 tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244476-358 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:27:53 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:53 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:27:53 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244476-359 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244476-360 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244477-361 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244477-362 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244477-363 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244477-364 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244477-365 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:53 notice: run_graph: Transition 189: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:53 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:53 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:53 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:27:53 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:53 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:53 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:53 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: unpack_graph: Unpacked transition 190: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:53 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:53 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:53 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:53 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:53 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:53 info: process_pe_message: Transition 190: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-239.bz2 tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-366 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:54 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-367 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-368 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-369 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-370 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-371 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-372 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:54 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244478-373 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:54 notice: run_graph: Transition 190: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:27:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:54 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:54 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: unpack_graph: Unpacked transition 191: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:54 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:54 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:54 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:54 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:54 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:54 info: process_pe_message: Transition 191: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-240.bz2 tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-374 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:55 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-375 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:55 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-376 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-377 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-378 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-379 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-380 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244479-381 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:55 notice: run_graph: Transition 191: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:55 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:27:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:55 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: unpack_graph: Unpacked transition 192: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:55 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:55 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:55 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:55 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:55 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:55 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:55 info: process_pe_message: Transition 192: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-241.bz2 tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-382 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:56 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-383 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-384 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-385 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-386 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-387 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:56 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-388 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:56 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244480-389 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:56 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:56 notice: run_graph: Transition 192: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:27:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:27:57 info: unpack_graph: Unpacked transition 193: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:57 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:56 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:56 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:56 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:56 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:56 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:56 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:57 info: process_pe_message: Transition 193: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-242.bz2 cib[741]: 2007/09/19_19:27:58 WARN: do_cib_notify: cib_modify of FAILED: The object/attribute does not exist cib[741]: 2007/09/19_19:27:58 ERROR: cib_process_request: cib_modify operation failed: The object/attribute does not exist cib[741]: 2007/09/19_19:27:58 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:27:58 info: MSG: Dumping message with 8 fields cib[741]: 2007/09/19_19:27:58 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:27:58 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:27:58 info: MSG[2] : [cib_op=cib_modify] cib[741]: 2007/09/19_19:27:58 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_19:27:58 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:27:58 info: MSG[5] : [(2)cib_calldata=0x95e0010(67 83)] cib[741]: 2007/09/19_19:27:58 info: cib[741]: 2007/09/19_19:27:58 info: MSG[6] : [cib_clientid=325785f3-ec06-4f79-9413-abeb0f28bd82] cib[741]: 2007/09/19_19:27:58 info: MSG[7] : [cib_clientname=7218] tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-390 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-391 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-392 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-393 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-394 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-395 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-396 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244481-397 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:58 notice: run_graph: Transition 193: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:27:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:58 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:58 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:58 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:58 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: unpack_graph: Unpacked transition 194: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:58 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:58 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:58 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:27:58 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:58 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:27:58 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:27:58 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:58 info: process_pe_message: Transition 194: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-243.bz2 tengine[2002]: 2007/09/19_19:27:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-398 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:58 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:27:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:27:58 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-399 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-400 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-401 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-402 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-403 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-404 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244482-405 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:27:59 notice: run_graph: Transition 194: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:27:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:27:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:27:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:27:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:27:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:27:59 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:27:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:59 info: unpack_graph: Unpacked transition 195: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:27:59 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:27:59 info: process_pe_message: Transition 195: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-244.bz2 tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-406 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:28:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:00 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:00 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-407 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-408 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-409 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-410 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-411 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-412 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-413 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:00 notice: run_graph: Transition 195: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:00 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:00 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:00 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:00 info: unpack_graph: Unpacked transition 196: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:00 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:00 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:00 info: process_pe_message: Transition 196: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-245.bz2 tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-414 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:01 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-415 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-416 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-417 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-418 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-419 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-420 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244484-421 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:01 notice: run_graph: Transition 196: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:28:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:01 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: unpack_graph: Unpacked transition 197: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:01 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:01 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:01 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:01 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:01 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:01 info: process_pe_message: Transition 197: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-246.bz2 tengine[2002]: 2007/09/19_19:28:02 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-422 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:02 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:02 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:02 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-423 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-424 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-425 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-426 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-427 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-428 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244486-429 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:03 notice: run_graph: Transition 197: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: native_print: mysql (heartbeat::ocf:mysql): Stopped crmd[745]: 2007/09/19_19:28:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:03 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:03 info: unpack_graph: Unpacked transition 198: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:03 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:03 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:03 info: process_pe_message: Transition 198: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-247.bz2 tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-430 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:04 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-431 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-432 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-433 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-434 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-435 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-436 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244487-437 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:04 notice: run_graph: Transition 198: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:04 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:04 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:04 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: unpack_graph: Unpacked transition 199: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:04 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:04 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:04 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:04 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:04 info: process_pe_message: Transition 199: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-248.bz2 tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-438 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:05 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-439 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-440 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-441 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-442 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-443 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-444 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244488-445 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:05 notice: run_graph: Transition 199: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:28:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:05 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: unpack_graph: Unpacked transition 200: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:05 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:05 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:05 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:05 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:05 info: process_pe_message: Transition 200: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-249.bz2 tengine[2002]: 2007/09/19_19:28:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-446 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:06 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:06 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:06 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-447 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-448 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-449 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-450 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-451 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-452 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244490-453 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:07 notice: run_graph: Transition 200: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:28:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:07 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:07 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:07 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:07 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:07 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:07 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:07 info: unpack_graph: Unpacked transition 201: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:07 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:07 info: process_pe_message: Transition 201: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-250.bz2 tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:07 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca cib[741]: 2007/09/19_19:28:08 ERROR: No declaration for attribute on_fail of element primitive cib[741]: 2007/09/19_19:28:08 ERROR: validate_with_dtd: CIB does not validate against /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:08 ERROR: activateCibXml: Ignoring invalid CIB cib[741]: 2007/09/19_19:28:08 WARN: activateCibXml: Reverting to last known CIB cib[741]: 2007/09/19_19:28:08 WARN: cib_process_command: Activation failed cib[741]: 2007/09/19_19:28:08 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:08 WARN: cib_diff_notify: Update (client: 7220, call:2): 0.87.12 -> 0.88.1 (Update does conform to the DTD in /usr/share/heartbeat/crm.dtd) cibmon[739]: 2007/09/19_19:28:08 WARN: cibmon_diff: [cib_diff_notify] cib_modify ABORTED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[739]: 2007/09/19_19:28:08 WARN: log_cib_diff: cib_modify: Diff: --- 0.87.12 cibmon[739]: 2007/09/19_19:28:08 WARN: log_cib_diff: cib_modify: Diff: +++ 0.88.1 cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 WARN: log_data_element: cib_modify: + cibmon[739]: 2007/09/19_19:28:08 info: log_data_element: raw_update: cib[741]: 2007/09/19_19:28:08 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:08 ERROR: cib_process_request: cib_modify operation failed: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:08 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:28:08 info: MSG: Dumping message with 8 fields cib[741]: 2007/09/19_19:28:08 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:28:08 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:28:08 info: MSG[2] : [cib_op=cib_modify] cib[741]: 2007/09/19_19:28:08 info: MSG[3] : [cib_callid=2] cib[741]: 2007/09/19_19:28:08 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:28:08 info: MSG[5] : [(2)cib_calldata=0x9597630(69 85)] cib[741]: 2007/09/19_19:28:08 info: cib[741]: 2007/09/19_19:28:08 info: MSG[6] : [cib_clientid=2ae5aba0-0393-444e-8b0c-e994bbaecc7f] cib[741]: 2007/09/19_19:28:08 info: MSG[7] : [cib_clientname=7220] tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-454 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:08 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-455 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-456 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-457 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-458 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-459 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-460 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244491-461 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:08 notice: run_graph: Transition 201: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:08 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:28:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:08 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:08 info: unpack_graph: Unpacked transition 202: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:08 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:08 info: process_pe_message: Transition 202: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-251.bz2 tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-462 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:09 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-463 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-464 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-465 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-466 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:09 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:09 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-467 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-468 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244492-469 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:09 notice: run_graph: Transition 202: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:09 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:09 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:09 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:09 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:09 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:09 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:09 info: unpack_graph: Unpacked transition 203: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:09 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:09 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:09 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:09 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:09 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:09 info: process_pe_message: Transition 203: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-252.bz2 tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-470 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:10 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-471 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-472 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-473 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-474 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:10 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-475 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-476 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244493-477 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:10 notice: run_graph: Transition 203: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:10 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:10 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:10 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:28:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:10 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:10 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:10 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:10 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:10 info: unpack_graph: Unpacked transition 204: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:10 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:10 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:10 info: process_pe_message: Transition 204: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-253.bz2 tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-478 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:11 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-479 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-480 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-481 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-482 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-483 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-484 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244494-485 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:11 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:11 notice: run_graph: Transition 204: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:11 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:11 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:11 info: unpack_graph: Unpacked transition 205: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:11 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:11 info: process_pe_message: Transition 205: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-254.bz2 tengine[2002]: 2007/09/19_19:28:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-486 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:12 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:12 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:12 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-487 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-488 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-489 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-490 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:13 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-491 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-492 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244496-493 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:13 notice: run_graph: Transition 205: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:28:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:13 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:13 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: unpack_graph: Unpacked transition 206: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:13 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:13 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:13 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:13 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:13 info: process_pe_message: Transition 206: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-255.bz2 tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-494 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:14 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-495 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:14 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-496 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:14 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-497 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-498 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-499 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244497-500 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-501 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:14 notice: run_graph: Transition 206: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:28:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:14 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:14 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:14 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: unpack_graph: Unpacked transition 207: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:14 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:14 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:14 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:14 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:14 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:14 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:14 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:14 info: process_pe_message: Transition 207: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-256.bz2 tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-502 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:15 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-503 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-504 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-505 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-506 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-507 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244498-508 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244499-509 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:15 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:15 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:15 notice: run_graph: Transition 207: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:15 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:15 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: unpack_graph: Unpacked transition 208: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:15 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:15 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:15 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:15 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:15 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:15 info: process_pe_message: Transition 208: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-257.bz2 tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-510 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:17 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-511 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-512 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-513 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-514 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-515 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-516 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244500-517 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:17 info: run_graph: ==================================================== crmd[745]: 2007/09/19_19:28:17 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:17 notice: run_graph: Transition 208: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:17 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:17 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:17 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: unpack_graph: Unpacked transition 209: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:17 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:17 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:17 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:17 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:17 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:17 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:17 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:17 info: process_pe_message: Transition 209: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-258.bz2 tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244501-518 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:18 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244501-519 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-520 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-521 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:18 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-522 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-523 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-524 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244502-525 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:18 notice: run_graph: Transition 209: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:18 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:28:18 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:18 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:18 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:18 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:18 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:18 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:18 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:18 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:18 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:18 info: process_pe_message: Transition 210: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-259.bz2 tengine[2002]: 2007/09/19_19:28:18 info: unpack_graph: Unpacked transition 210: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:18 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-526 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:19 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-527 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-528 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-529 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-530 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-531 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-532 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244503-533 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:19 notice: run_graph: Transition 210: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:28:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: unpack_graph: Unpacked transition 211: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:19 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:19 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:19 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:19 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:19 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:19 info: process_pe_message: Transition 211: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-260.bz2 tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-534 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-535 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-536 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-537 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-538 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-539 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:20 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-540 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244504-541 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:21 notice: run_graph: Transition 211: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) crmd[745]: 2007/09/19_19:28:21 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[745]: 2007/09/19_19:28:21 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:28:21 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:21 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:21 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:21 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: unpack_graph: Unpacked transition 212: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:21 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:21 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:21 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:21 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:21 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:21 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:21 info: process_pe_message: Transition 212: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-261.bz2 tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-542 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:22 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-543 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-544 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-545 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-546 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-547 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-548 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244506-549 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:22 notice: run_graph: Transition 212: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:22 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:22 info: unpack_graph: Unpacked transition 213: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:22 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:22 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:22 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:22 info: process_pe_message: Transition 213: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-262.bz2 tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-550 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:23 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-551 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-552 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-553 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-554 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-555 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:23 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:23 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-556 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244507-557 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:23 notice: run_graph: Transition 213: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:23 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:23 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:23 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:23 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:23 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:23 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:23 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: unpack_graph: Unpacked transition 214: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:23 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:23 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:23 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:23 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:23 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:23 info: process_pe_message: Transition 214: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-263.bz2 tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-558 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:24 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-559 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-560 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-561 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-562 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-563 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-564 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:24 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244508-565 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:25 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:25 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:25 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:25 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:25 notice: run_graph: Transition 214: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:25 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:25 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:25 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:25 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:25 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:25 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:25 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:25 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:28:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:25 info: unpack_graph: Unpacked transition 215: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:25 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:25 info: process_pe_message: Transition 215: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-264.bz2 tengine[2002]: 2007/09/19_19:28:26 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-566 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:26 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:26 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:26 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-567 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-568 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-569 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:27 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-570 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:27 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-571 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-572 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244510-573 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:27 notice: run_graph: Transition 215: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:28:27 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:27 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:27 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:27 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: unpack_graph: Unpacked transition 216: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:27 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:27 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:27 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:27 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:27 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:27 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:27 info: process_pe_message: Transition 216: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-265.bz2 tengine[2002]: 2007/09/19_19:28:27 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-574 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:27 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:27 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:27 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-575 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-576 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-577 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:28 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-578 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-579 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-580 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244511-581 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:28 notice: run_graph: Transition 216: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:28 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:28 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:28 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:28 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:28 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:28 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:28 info: process_pe_message: Transition 217: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-266.bz2 crmd[745]: 2007/09/19_19:28:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:28 info: unpack_graph: Unpacked transition 217: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:28 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-582 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:29 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-583 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-584 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:29 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-585 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-586 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-587 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-588 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244512-589 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:29 notice: run_graph: Transition 217: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:29 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:29 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:29 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:29 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:29 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:29 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: unpack_graph: Unpacked transition 218: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:29 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:29 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:29 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:29 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:29 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:29 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:29 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:29 info: process_pe_message: Transition 218: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-267.bz2 tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-590 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:30 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-591 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-592 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:30 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-593 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:30 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-594 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-595 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-596 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244513-597 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:30 notice: run_graph: Transition 218: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:30 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:30 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:30 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:30 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:30 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:30 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:30 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:30 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:30 info: unpack_graph: Unpacked transition 219: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:30 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:30 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:30 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:30 info: process_pe_message: Transition 219: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-268.bz2 tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-598 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:31 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-599 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-600 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-601 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:31 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-602 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-603 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-604 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244515-605 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:31 notice: run_graph: Transition 219: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:31 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:31 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:31 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:31 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:31 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:31 info: unpack_graph: Unpacked transition 220: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:31 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:31 info: process_pe_message: Transition 220: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-269.bz2 tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-606 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:32 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-607 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-608 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-609 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-610 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-611 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-612 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:32 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244516-613 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:32 notice: run_graph: Transition 220: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[745]: 2007/09/19_19:28:32 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:32 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:32 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:32 info: unpack_graph: Unpacked transition 221: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:32 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:32 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:32 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:32 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:32 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:32 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:32 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:32 info: process_pe_message: Transition 221: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-270.bz2 tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-614 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:33 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:28:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:33 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-615 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-616 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-617 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-618 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-619 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-620 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244517-621 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:33 notice: run_graph: Transition 221: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:33 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:33 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:33 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:33 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:33 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:33 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:33 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:33 info: unpack_graph: Unpacked transition 222: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:33 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:33 info: process_pe_message: Transition 222: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-271.bz2 tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-622 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:28:34 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:34 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:34 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-623 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-624 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-625 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-626 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-627 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-628 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244518-629 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:34 notice: run_graph: Transition 222: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:34 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:34 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:34 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:34 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:34 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:34 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:34 info: unpack_graph: Unpacked transition 223: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:34 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:34 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:34 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:34 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:34 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:34 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:34 info: process_pe_message: Transition 223: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-272.bz2 cib[741]: 2007/09/19_19:28:35 ERROR: No declaration for attribute on_fail of element primitive cib[741]: 2007/09/19_19:28:35 ERROR: validate_with_dtd: CIB does not validate against /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:35 ERROR: activateCibXml: Ignoring invalid CIB cib[741]: 2007/09/19_19:28:35 WARN: activateCibXml: Reverting to last known CIB cibmon[739]: 2007/09/19_19:28:35 WARN: cibmon_diff: [cib_diff_notify] cib_modify ABORTED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cib[741]: 2007/09/19_19:28:35 WARN: cib_process_command: Activation failed cibmon[739]: 2007/09/19_19:28:35 WARN: log_cib_diff: cib_modify: Diff: --- 0.87.12 cib[741]: 2007/09/19_19:28:35 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[739]: 2007/09/19_19:28:35 WARN: log_cib_diff: cib_modify: Diff: +++ 0.88.1 cib[741]: 2007/09/19_19:28:35 WARN: cib_diff_notify: Update (client: 7231, call:2): 0.87.12 -> 0.88.1 (Update does conform to the DTD in /usr/share/heartbeat/crm.dtd) cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: - cib[741]: 2007/09/19_19:28:35 WARN: do_cib_notify: cib_modify of FAILED: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 ERROR: cib_process_request: cib_modify operation failed: Update does conform to the DTD in /usr/share/heartbeat/crm.dtd cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: crm_log_message_adv: #========= Input message message start ==========# cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: MSG: Dumping message with 8 fields cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: MSG[0] : [__name__=cib_command] cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: MSG[1] : [t=cib] cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: MSG[2] : [cib_op=cib_modify] cibmon[739]: 2007/09/19_19:28:35 WARN: log_data_element: cib_modify: + cib[741]: 2007/09/19_19:28:35 info: MSG[3] : [cib_callid=2] cibmon[739]: 2007/09/19_19:28:35 info: log_data_element: raw_update: cib[741]: 2007/09/19_19:28:35 info: MSG[4] : [cib_callopt=0] cib[741]: 2007/09/19_19:28:35 info: MSG[5] : [(2)cib_calldata=0x958d318(69 85)] cib[741]: 2007/09/19_19:28:35 info: cib[741]: 2007/09/19_19:28:35 info: MSG[6] : [cib_clientid=96d50e8b-3264-4a90-b7ac-3b53df1ca42a] cib[741]: 2007/09/19_19:28:35 info: MSG[7] : [cib_clientname=7231] tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-630 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:35 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-631 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:35 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:35 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-632 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-633 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-634 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-635 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-636 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244519-637 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:35 notice: run_graph: Transition 223: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:28:35 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:35 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:35 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:35 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:35 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: unpack_graph: Unpacked transition 224: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:35 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:35 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:35 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:35 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:35 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:35 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:35 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:35 info: process_pe_message: Transition 224: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-273.bz2 tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-638 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:36 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-639 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:36 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-640 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-641 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-642 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-643 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-644 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244520-645 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:36 notice: run_graph: Transition 224: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:36 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:36 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:36 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:36 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: unpack_graph: Unpacked transition 225: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:36 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:36 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:36 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:36 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:36 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:36 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:36 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:36 info: process_pe_message: Transition 225: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-274.bz2 tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-646 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:37 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-647 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-648 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-649 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-650 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-651 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:37 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:37 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-652 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244521-653 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:37 notice: run_graph: Transition 225: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:37 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:37 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:37 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:37 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:37 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:37 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:37 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:37 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:37 notice: StartRsc: host-2.awale.qc.ca Start msg_last crmd[745]: 2007/09/19_19:28:37 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:37 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:37 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:37 info: unpack_graph: Unpacked transition 226: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:37 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:37 info: process_pe_message: Transition 226: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-275.bz2 tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-654 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:28:38 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:38 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:38 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-655 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-656 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-657 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-658 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-659 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-660 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244522-661 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:38 notice: run_graph: Transition 226: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:38 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:38 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:38 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:38 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:38 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:38 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:38 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:38 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:38 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:38 info: unpack_graph: Unpacked transition 227: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:38 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:38 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:38 info: process_pe_message: Transition 227: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-276.bz2 tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-662 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:39 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-663 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-664 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-665 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-666 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-667 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:39 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-668 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244523-669 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:39 notice: run_graph: Transition 227: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:39 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:39 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:39 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:39 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:39 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:39 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:39 info: unpack_graph: Unpacked transition 228: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:39 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:39 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:39 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:39 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:39 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:39 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:39 info: process_pe_message: Transition 228: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-277.bz2 tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-670 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:28:40 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:40 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:40 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-671 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-672 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-673 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-674 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-675 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-676 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244524-677 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:40 notice: run_graph: Transition 228: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:28:40 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:40 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:40 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:40 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:40 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: unpack_graph: Unpacked transition 229: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:40 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:40 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:40 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:40 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:40 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:40 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:40 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:40 info: process_pe_message: Transition 229: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-278.bz2 tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-678 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:41 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:41 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-679 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:41 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-680 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-681 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-682 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-683 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-684 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244525-685 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:41 notice: run_graph: Transition 229: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:41 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:41 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:41 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:41 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:41 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:41 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: unpack_graph: Unpacked transition 230: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:41 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:41 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:41 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:41 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:41 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:41 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:41 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:41 info: process_pe_message: Transition 230: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-279.bz2 tengine[2002]: 2007/09/19_19:28:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-686 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:42 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:42 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:42 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-687 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-688 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-689 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:43 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:43 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-690 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-691 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-692 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244526-693 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:43 notice: run_graph: Transition 230: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:43 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:43 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:28:43 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:43 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:43 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:43 info: unpack_graph: Unpacked transition 231: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:43 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:43 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:43 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:43 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:43 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:43 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:43 info: process_pe_message: Transition 231: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-280.bz2 tengine[2002]: 2007/09/19_19:28:43 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-694 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:43 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:43 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:43 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-695 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-696 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-697 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-698 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-699 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:44 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-700 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:44 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244527-701 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:44 notice: run_graph: Transition 231: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:44 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:44 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:44 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:44 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:44 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:44 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:44 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:44 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:44 info: unpack_graph: Unpacked transition 232: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:44 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:44 info: process_pe_message: Transition 232: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-281.bz2 tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:44 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-702 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:45 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-703 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-704 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:45 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:45 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-705 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-706 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-707 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-708 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244529-709 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:45 notice: run_graph: Transition 232: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:45 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:45 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:45 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:45 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:45 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:45 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: unpack_graph: Unpacked transition 233: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:45 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:45 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:45 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:45 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:45 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:45 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:45 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:45 info: process_pe_message: Transition 233: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-282.bz2 tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-710 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:46 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:46 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-711 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:46 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-712 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-713 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-714 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-715 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-716 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244530-717 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:46 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:46 notice: run_graph: Transition 233: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:46 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:28:46 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:46 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:46 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:46 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:46 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:46 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:46 info: unpack_graph: Unpacked transition 234: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:46 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:46 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:46 info: process_pe_message: Transition 234: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-283.bz2 tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-718 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:47 info: update_abort_priority: Abort action 0 superceeded by 2 crmd[745]: 2007/09/19_19:28:47 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:47 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-719 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-720 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-721 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-722 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-723 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-724 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244531-725 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:47 notice: run_graph: Transition 234: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:47 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:47 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:47 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:47 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:47 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:47 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: unpack_graph: Unpacked transition 235: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:47 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:47 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:47 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:47 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:47 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:47 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:47 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:47 info: process_pe_message: Transition 235: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-284.bz2 tengine[2002]: 2007/09/19_19:28:48 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-726 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:48 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:48 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:48 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-727 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-728 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-729 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-730 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:49 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:49 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-731 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-732 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244532-733 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:49 notice: run_graph: Transition 235: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:49 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:28:49 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:49 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:49 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:49 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: unpack_graph: Unpacked transition 236: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:49 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:49 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:49 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:49 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:49 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:49 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:49 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:49 info: process_pe_message: Transition 236: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-285.bz2 tengine[2002]: 2007/09/19_19:28:49 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-734 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:49 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:49 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:49 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-735 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:50 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:50 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-736 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-737 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-738 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-739 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-740 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244533-741 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:50 notice: run_graph: Transition 236: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' crmd[745]: 2007/09/19_19:28:50 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:50 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:50 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:50 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:50 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:50 info: unpack_graph: Unpacked transition 237: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:50 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:50 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:50 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:50 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:50 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:50 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:50 info: process_pe_message: Transition 237: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-286.bz2 tengine[2002]: 2007/09/19_19:28:51 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-742 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:51 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:51 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:51 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-743 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-744 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-745 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-746 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-747 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:52 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-748 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:52 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244535-749 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:52 notice: run_graph: Transition 237: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:52 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:52 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:52 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:52 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:52 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:52 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: unpack_graph: Unpacked transition 238: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:52 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:52 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:52 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:52 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:52 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:52 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:52 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:52 info: process_pe_message: Transition 238: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-287.bz2 tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-750 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:54 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-751 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-752 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-753 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:54 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-754 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:54 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-755 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-756 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244537-757 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:54 notice: run_graph: Transition 238: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:54 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:54 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:28:54 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:54 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:54 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: unpack_graph: Unpacked transition 239: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:54 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:54 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:54 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:54 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:54 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:54 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:54 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:54 info: process_pe_message: Transition 239: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-288.bz2 tengine[2002]: 2007/09/19_19:28:54 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-758 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:54 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:54 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:54 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-759 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-760 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-761 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-762 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-763 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:55 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:55 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-764 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244538-765 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:55 notice: run_graph: Transition 239: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:55 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:55 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:55 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:55 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca crmd[745]: 2007/09/19_19:28:55 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:55 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:55 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:55 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:55 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:28:55 info: unpack_graph: Unpacked transition 240: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:55 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:55 info: process_pe_message: Transition 240: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-289.bz2 tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-766 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:55 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-767 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-768 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-769 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-770 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-771 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:55 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-772 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:56 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:56 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244539-773 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:56 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:56 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:56 notice: run_graph: Transition 240: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:56 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:56 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:56 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:28:56 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:56 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:56 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:56 info: unpack_graph: Unpacked transition 241: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:56 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:56 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:56 info: process_pe_message: Transition 241: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-290.bz2 tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-774 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:57 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-775 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-776 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-777 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-778 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:57 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-779 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:57 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-780 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244541-781 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:57 notice: run_graph: Transition 241: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:57 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:28:57 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:57 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:57 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: unpack_graph: Unpacked transition 242: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:57 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:28:57 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:57 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:57 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:57 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:57 info: process_pe_message: Transition 242: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-291.bz2 tengine[2002]: 2007/09/19_19:28:58 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-782 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:58 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:58 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-783 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-784 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-785 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-786 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-787 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:59 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:28:59 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-788 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244542-789 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:28:59 notice: run_graph: Transition 242: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:28:59 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:28:59 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:28:59 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:28:59 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: unpack_graph: Unpacked transition 243: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:28:59 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: determine_online_status: Node host-2.awale.qc.ca is online tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:28:59 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:28:59 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:28:59 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:28:59 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:28:59 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:28:59 info: process_pe_message: Transition 243: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-292.bz2 tengine[2002]: 2007/09/19_19:28:59 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-790 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:28:59 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:28:59 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:28:59 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-791 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:00 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-792 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:00 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-793 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-794 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-795 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-796 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244543-797 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:00 notice: run_graph: Transition 243: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:00 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:00 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:00 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:29:00 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:00 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:00 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: unpack_graph: Unpacked transition 244: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:00 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:00 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:00 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:00 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:00 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:00 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:00 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:00 info: process_pe_message: Transition 244: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-293.bz2 tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-798 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:01 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-799 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-800 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-801 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-802 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:01 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-803 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:01 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-804 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244545-805 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:01 notice: run_graph: Transition 244: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:01 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:01 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:01 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:29:01 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:01 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:01 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: unpack_graph: Unpacked transition 245: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:01 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:01 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:01 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:01 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:01 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:01 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:01 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:01 info: process_pe_message: Transition 245: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-294.bz2 tengine[2002]: 2007/09/19_19:29:02 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-806 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:02 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:02 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:02 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-807 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-808 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-809 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-810 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-811 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:03 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-812 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244546-813 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:03 notice: run_graph: Transition 245: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:03 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:29:03 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:03 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:03 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:03 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: unpack_graph: Unpacked transition 246: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:03 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:03 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:03 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:03 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:03 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:03 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:03 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:03 info: process_pe_message: Transition 246: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-295.bz2 tengine[2002]: 2007/09/19_19:29:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-814 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:03 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:03 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:03 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-815 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-816 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-817 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-818 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-819 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-820 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244547-821 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:04 notice: run_graph: Transition 246: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:04 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:04 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:04 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:04 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:04 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:04 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:29:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:04 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:04 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:04 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:04 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:04 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:04 info: unpack_graph: Unpacked transition 247: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:04 info: process_pe_message: Transition 247: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-296.bz2 tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-822 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:04 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-823 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:04 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-824 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-825 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-826 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:05 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-827 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-828 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244548-829 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:05 notice: run_graph: Transition 247: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:05 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:05 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:05 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:05 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:05 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:05 info: unpack_graph: Unpacked transition 248: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:05 notice: StartRsc: host-2.awale.qc.ca Start msg_last tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:05 info: process_pe_message: Transition 248: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-297.bz2 tengine[2002]: 2007/09/19_19:29:05 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-830 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:05 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:05 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:05 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-831 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-832 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:06 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-833 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-834 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-835 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-836 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244549-837 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:06 notice: run_graph: Transition 248: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:06 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:29:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:06 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:06 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:06 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:06 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:06 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:06 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:06 info: unpack_graph: Unpacked transition 249: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:06 info: process_pe_message: Transition 249: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-298.bz2 tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:06 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-838 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:07 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-839 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-840 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-841 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-842 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-843 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-844 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:07 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244551-845 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:07 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:07 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:07 notice: run_graph: Transition 249: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:07 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:07 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:07 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:07 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:07 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:07 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:07 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:07 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:29:08 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:08 info: process_pe_message: Transition 250: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-299.bz2 tengine[2002]: 2007/09/19_19:29:08 info: unpack_graph: Unpacked transition 250: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-846 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:08 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:08 info: update_abort_priority: Abort priority upgraded to 1 crmd[745]: 2007/09/19_19:29:08 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:08 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-847 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-848 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-849 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-850 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-851 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-852 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244552-853 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:08 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:08 notice: run_graph: Transition 250: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:08 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:29:09 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:08 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:08 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:08 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:09 info: unpack_graph: Unpacked transition 251: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:08 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:08 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:29:09 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:08 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:08 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:08 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:08 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:09 info: process_pe_message: Transition 251: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-300.bz2 tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-854 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:10 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-855 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:10 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-856 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:10 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-857 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-858 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-859 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-860 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244553-861 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:10 notice: run_graph: Transition 251: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:10 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:10 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:10 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:29:10 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:10 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:10 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:10 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: unpack_graph: Unpacked transition 252: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:10 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:29:10 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:10 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:10 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:10 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:10 info: process_pe_message: Transition 252: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-301.bz2 tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-862 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:10 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-863 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:10 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-864 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-865 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-866 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-867 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-868 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244554-869 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:11 notice: run_graph: Transition 252: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:11 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:11 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:11 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:11 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) crmd[745]: 2007/09/19_19:29:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:11 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:11 info: unpack_graph: Unpacked transition 253: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:11 info: process_pe_message: Transition 253: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-302.bz2 tengine[2002]: 2007/09/19_19:29:11 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-870 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:11 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:11 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:11 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-871 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-872 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-873 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-874 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:12 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:12 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-875 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-876 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244555-877 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:12 notice: run_graph: Transition 253: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:12 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:12 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:29:12 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:12 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:12 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: unpack_graph: Unpacked transition 254: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:12 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:12 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:12 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:12 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:12 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:12 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:12 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:12 info: process_pe_message: Transition 254: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-303.bz2 tengine[2002]: 2007/09/19_19:29:12 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-878 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:12 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:12 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:12 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-879 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-880 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-881 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-882 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-883 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-884 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:13 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244556-885 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:13 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:13 notice: run_graph: Transition 254: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:13 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:13 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[745]: 2007/09/19_19:29:13 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:13 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:13 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:13 info: unpack_graph: Unpacked transition 255: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:13 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:29:13 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:13 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:13 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:13 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:13 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:13 info: process_pe_message: Transition 255: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-304.bz2 tengine[2002]: 2007/09/19_19:29:13 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-886 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:13 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:13 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:13 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-887 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-888 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-889 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:14 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:14 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-890 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-891 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-892 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244557-893 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:14 notice: run_graph: Transition 255: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:14 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:14 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:14 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:14 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:14 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:14 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:14 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[2003]: 2007/09/19_19:29:14 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 crmd[745]: 2007/09/19_19:29:14 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:14 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:14 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:14 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:14 info: unpack_graph: Unpacked transition 256: 14 actions in 14 synapses tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:14 info: process_pe_message: Transition 256: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-305.bz2 tengine[2002]: 2007/09/19_19:29:14 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-894 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:14 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:14 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:14 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-895 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-896 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-897 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:15 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:15 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-898 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-899 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-900 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244558-901 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:15 notice: run_graph: Transition 256: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:15 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:15 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:15 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: determine_online_status: Node host-2.awale.qc.ca is online crmd[745]: 2007/09/19_19:29:15 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:15 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:15 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:15 info: unpack_graph: Unpacked transition 257: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:15 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource share-drbd (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource share-drbdlinks (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource share-FS (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: StartRsc: host-2.awale.qc.ca Start mysql tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:15 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:15 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[2003]: 2007/09/19_19:29:15 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[2003]: 2007/09/19_19:29:15 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-2.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:15 info: process_pe_message: Transition 257: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-306.bz2 tengine[2002]: 2007/09/19_19:29:15 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-902 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:15 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:15 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:15 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:16 info: handle_shutdown_request: Creating shutdown request for host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-903 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-904 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-905 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-906 from host-2.awale.qc.ca crmd[745]: 2007/09/19_19:29:16 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-907 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-908 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244559-909 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: run_graph: ==================================================== tengine[2002]: 2007/09/19_19:29:16 notice: run_graph: Transition 257: (Complete=8, Pending=0, Fired=0, Skipped=5, Incomplete=1) cibmon[739]: 2007/09/19_19:29:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:29:16 info: log_cib_diff: cib_update: Diff: --- 0.87.12 cibmon[739]: 2007/09/19_19:29:16 info: log_cib_diff: cib_update: Diff: +++ 0.87.13 tengine[2002]: 2007/09/19_19:29:16 info: extract_event: Aborting on shutdown attribute for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:29:16 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:16 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:16 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:29:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:16 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[2003]: 2007/09/19_19:29:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: unpack_graph: Unpacked transition 258: 16 actions in 16 synapses pengine[2003]: 2007/09/19_19:29:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 9: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 10: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 19: share-drbdlinks_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 11: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 12: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 13: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource msg_last cannot run anywhere tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 14: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource msg_first cannot run anywhere tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 15: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource mysql cannot run anywhere tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 16: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource share-FS cannot run anywhere tengine[2002]: 2007/09/19_19:29:16 info: send_rsc_command: Initiating action 24: IPaddr_10_0_0_59_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:29:16 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:29:16 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[2003]: 2007/09/19_19:29:16 notice: StopRsc: host-2.awale.qc.ca Stop share-drbdlinks pengine[2003]: 2007/09/19_19:29:16 notice: StopRsc: host-2.awale.qc.ca Stop share-FS pengine[2003]: 2007/09/19_19:29:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:16 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:29:16 notice: StopRsc: host-2.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[2003]: 2007/09/19_19:29:16 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:29:16 WARN: process_pe_message: Transition 258: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-180.bz2 pengine[2003]: 2007/09/19_19:29:16 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-911 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:16 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action share-drbd_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-912 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:16 info: match_graph_event: Action share-drbdlinks_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-913 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action share-FS_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-914 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action vmstat-mon_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-915 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action mysql_monitor_0 (13) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-916 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action msg_first_monitor_0 (14) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-917 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action msg_last_monitor_0 (15) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244560-918 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:17 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_delete: Diff: --- 0.87.13 cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_delete: Diff: +++ 0.87.14 cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:29:17 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_delete: Diff: --- 0.87.14 cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_delete: Diff: +++ 0.87.15 cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:29:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:29:17 WARN: status_from_rc: Action stop on host-2.awale.qc.ca failed (target: vs. rc: 1): Error cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_update: Diff: --- 0.87.15 tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action share-drbdlinks_stop_0 (19) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_update: Diff: +++ 0.87.16 cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_update: Diff: --- 0.87.16 tengine[2002]: 2007/09/19_19:29:17 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (24) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:17 info: log_cib_diff: cib_update: Diff: +++ 0.87.17 tengine[2002]: 2007/09/19_19:29:17 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:29:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:17 notice: run_graph: Transition 258: (Complete=10, Pending=0, Fired=0, Skipped=5, Incomplete=1) cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:29:17 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:17 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:17 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:17 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca crmd[745]: 2007/09/19_19:29:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:29:17 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: unpack_graph: Unpacked transition 259: 14 actions in 14 synapses pengine[2003]: 2007/09/19_19:29:17 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 7: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 8: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 9: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 18: share-FS_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 10: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 11: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 12: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource msg_last cannot run anywhere tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 13: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource msg_first cannot run anywhere tengine[2002]: 2007/09/19_19:29:17 info: send_rsc_command: Initiating action 14: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:29:17 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:29:17 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[2003]: 2007/09/19_19:29:17 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:17 notice: StopRsc: host-2.awale.qc.ca Stop share-FS pengine[2003]: 2007/09/19_19:29:17 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:17 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:29:17 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:29:17 WARN: process_pe_message: Transition 259: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-181.bz2 pengine[2003]: 2007/09/19_19:29:17 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244561-919 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:18 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:18 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action share-drbd_monitor_0 (7) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244561-920 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action share-drbdlinks_monitor_0 (8) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244561-921 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action share-FS_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_cib_diff: cib_delete: Diff: --- 0.87.17 tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244562-922 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_cib_diff: cib_delete: Diff: +++ 0.87.18 tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action vmstat-mon_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244562-923 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action mysql_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244562-924 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action msg_first_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244562-925 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action msg_last_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244562-926 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:18 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:18 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:29:19 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:29:19 info: match_graph_event: Action share-FS_stop_0 (18) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:19 info: log_cib_diff: cib_update: Diff: --- 0.87.18 crmd[745]: 2007/09/19_19:29:19 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:19 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:29:19 info: log_cib_diff: cib_update: Diff: +++ 0.87.19 crmd[745]: 2007/09/19_19:29:19 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:19 notice: run_graph: Transition 259: (Complete=9, Pending=0, Fired=0, Skipped=4, Incomplete=1) cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:19 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:19 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:29:19 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:19 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:19 info: unpack_graph: Unpacked transition 260: 13 actions in 13 synapses pengine[2003]: 2007/09/19_19:29:19 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 6: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 15: share-drbd_stop_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 7: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 8: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 9: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: msg_last (heartbeat:msg): Stopped tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 10: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 11: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 12: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere tengine[2002]: 2007/09/19_19:29:19 info: send_rsc_command: Initiating action 13: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:29:19 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[2003]: 2007/09/19_19:29:19 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:19 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:19 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[2003]: 2007/09/19_19:29:19 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:29:19 WARN: process_pe_message: Transition 260: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-182.bz2 pengine[2003]: 2007/09/19_19:29:19 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244563-927 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:20 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action share-drbd_monitor_0 (6) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-928 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action share-drbdlinks_monitor_0 (7) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-929 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action share-FS_monitor_0 (8) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-930 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action vmstat-mon_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-931 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action mysql_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-932 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action msg_first_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-933 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action msg_last_monitor_0 (12) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-934 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:20 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:29:20 info: log_cib_diff: cib_delete: Diff: --- 0.87.19 cibmon[739]: 2007/09/19_19:29:20 info: log_cib_diff: cib_delete: Diff: +++ 0.87.20 cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:29:20 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:29:20 info: log_cib_diff: cib_update: Diff: --- 0.87.20 cibmon[739]: 2007/09/19_19:29:20 info: log_cib_diff: cib_update: Diff: +++ 0.87.21 cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:29:20 WARN: status_from_rc: Action stop on host-2.awale.qc.ca failed (target: vs. rc: 20): Error cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:29:20 info: match_graph_event: Action share-drbd_stop_0 (15) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:29:20 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:20 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:29:20 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:29:20 notice: run_graph: Transition 260: (Complete=9, Pending=0, Fired=0, Skipped=3, Incomplete=1) cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:20 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:20 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:29:20 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:29:20 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:29:20 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:29:20 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:29:20 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:20 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:29:20 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:20 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource mysql cannot run anywhere crmd[745]: 2007/09/19_19:29:20 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:29:20 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:20 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:20 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) tengine[2002]: 2007/09/19_19:29:20 info: unpack_graph: Unpacked transition 261: 12 actions in 12 synapses pengine[2003]: 2007/09/19_19:29:20 notice: StopRsc: host-2.awale.qc.ca Stop msg_first tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 5: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 6: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 WARN: process_pe_message: Transition 261: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-183.bz2 tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 7: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:20 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 8: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 9: mysql_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 10: msg_first_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 18: msg_first_stop_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 11: msg_last_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:20 info: send_rsc_command: Initiating action 12: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-935 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:21 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:21 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action share-drbd_monitor_0 (5) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244564-936 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_cib_diff: cib_delete: Diff: --- 0.87.21 tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action share-drbdlinks_monitor_0 (6) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_cib_diff: cib_delete: Diff: +++ 0.87.22 tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-937 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action share-FS_monitor_0 (7) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-938 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action vmstat-mon_monitor_0 (8) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-939 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action mysql_monitor_0 (9) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-940 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action msg_first_monitor_0 (10) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-941 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action msg_last_monitor_0 (11) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244565-942 from host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - tengine[2002]: 2007/09/19_19:29:21 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:29:21 info: log_data_element: cib_delete: + cibmon[739]: 2007/09/19_19:29:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:29:22 info: log_cib_diff: cib_update: Diff: --- 0.87.22 cibmon[739]: 2007/09/19_19:29:22 info: log_cib_diff: cib_update: Diff: +++ 0.87.23 tengine[2002]: 2007/09/19_19:29:22 info: match_graph_event: Action msg_first_stop_0 (18) confirmed on host-2.awale.qc.ca cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:29:22 info: run_graph: ==================================================== cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:29:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:29:22 notice: run_graph: Transition 261: (Complete=9, Pending=0, Fired=0, Skipped=2, Incomplete=1) cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - crmd[745]: 2007/09/19_19:29:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:29:22 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:29:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' crmd[745]: 2007/09/19_19:29:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:29:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: determine_online_status: Node host-2.awale.qc.ca is shutting down tengine[2002]: 2007/09/19_19:29:22 info: unpack_graph: Unpacked transition 262: 11 actions in 11 synapses pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 4: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 5: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 6: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 7: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 8: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:29:22 info: send_rsc_command: Initiating action 11: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:29:22 info: te_crm_command: Executing crm-event (17): do_shutdown on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:29:22 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:29:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:29:22 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:22 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:29:22 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:22 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:29:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:29:22 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:29:22 WARN: process_pe_message: Transition 262: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-184.bz2 pengine[2003]: 2007/09/19_19:29:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-943 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:29:23 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action share-drbd_monitor_0 (4) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-944 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action share-drbdlinks_monitor_0 (5) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-945 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action share-FS_monitor_0 (6) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-946 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action vmstat-mon_monitor_0 (7) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-947 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action mysql_monitor_0 (8) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-948 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-949 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action msg_last_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244566-950 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:29:23 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 WARN: global_timer_callback: Timer popped (abort_level=1, complete=false) crmd[745]: 2007/09/19_19:31:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:31:02 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer crmd[745]: 2007/09/19_19:31:02 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:31:02 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions tengine[2002]: 2007/09/19_19:31:02 WARN: global_timer_callback: Transition abort timeout reached... marking transition complete. tengine[2002]: 2007/09/19_19:31:02 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[2002]: 2007/09/19_19:31:02 info: update_abort_priority: 'Event failed' abort superceeded tengine[2002]: 2007/09/19_19:31:02 WARN: global_timer_callback: Writing 1 unconfirmed actions to the CIB tengine[2002]: 2007/09/19_19:31:02 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer tengine[2002]: 2007/09/19_19:31:02 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' crmd[745]: 2007/09/19_19:31:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:31:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:31:02 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: unpack_graph: Unpacked transition 263: 11 actions in 11 synapses pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 4: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 5: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 6: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 info: determine_online_status: Node host-2.awale.qc.ca is shutting down tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 7: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 8: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: send_rsc_command: Initiating action 11: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:31:02 info: te_crm_command: Executing crm-event (17): do_shutdown on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED pengine[2003]: 2007/09/19_19:31:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:31:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:31:02 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:31:02 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:31:02 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:31:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:31:02 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:31:02 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:31:02 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:31:02 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:31:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:31:02 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:31:02 WARN: process_pe_message: Transition 263: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-185.bz2 pengine[2003]: 2007/09/19_19:31:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:31:02 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-951 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:02 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:31:02 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:31:02 info: match_graph_event: Action share-drbd_monitor_0 (4) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-952 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action share-drbdlinks_monitor_0 (5) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-953 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action share-FS_monitor_0 (6) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-954 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action vmstat-mon_monitor_0 (7) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-955 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action mysql_monitor_0 (8) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-956 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-957 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action msg_last_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244666-958 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:31:03 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (11) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 WARN: global_timer_callback: Timer popped (abort_level=1, complete=false) tengine[2002]: 2007/09/19_19:32:42 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer crmd[745]: 2007/09/19_19:32:42 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:32:42 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions crmd[745]: 2007/09/19_19:32:42 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:32:42 WARN: global_timer_callback: Transition abort timeout reached... marking transition complete. tengine[2002]: 2007/09/19_19:32:42 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[2002]: 2007/09/19_19:32:42 info: update_abort_priority: 'Event failed' abort superceeded tengine[2002]: 2007/09/19_19:32:42 WARN: global_timer_callback: Writing 1 unconfirmed actions to the CIB tengine[2002]: 2007/09/19_19:32:42 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer tengine[2002]: 2007/09/19_19:32:42 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:32:42 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:32:42 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:32:42 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: unpack_graph: Unpacked transition 264: 11 actions in 11 synapses pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 4: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: determine_online_status: Node host-2.awale.qc.ca is shutting down tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 5: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 6: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 7: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 8: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:32:42 info: send_rsc_command: Initiating action 11: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped tengine[2002]: 2007/09/19_19:32:42 info: te_crm_command: Executing crm-event (17): do_shutdown on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:32:42 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:32:42 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:32:42 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:32:42 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:32:42 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:32:42 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:32:42 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:32:42 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:32:42 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:32:42 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:32:42 WARN: process_pe_message: Transition 264: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-186.bz2 pengine[2003]: 2007/09/19_19:32:42 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-959 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: update_abort_priority: Abort priority upgraded to 1 tengine[2002]: 2007/09/19_19:32:42 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action share-drbd_monitor_0 (4) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-960 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action share-drbdlinks_monitor_0 (5) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-961 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action share-FS_monitor_0 (6) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-962 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action vmstat-mon_monitor_0 (7) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-963 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action mysql_monitor_0 (8) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-964 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action msg_first_monitor_0 (9) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-965 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action msg_last_monitor_0 (10) confirmed on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: process_te_message: Processing (N)ACK lrm_invoke-lrmd-1190244766-966 from host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:32:42 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (11) confirmed on host-2.awale.qc.ca heartbeat[728]: 2007/09/19_19:34:13 info: Link host-2.awale.qc.ca:eth0 dead. tengine[2002]: 2007/09/19_19:34:22 WARN: global_timer_callback: Timer popped (abort_level=1, complete=false) tengine[2002]: 2007/09/19_19:34:22 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer crmd[745]: 2007/09/19_19:34:22 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:34:22 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions crmd[745]: 2007/09/19_19:34:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:34:22 WARN: global_timer_callback: Transition abort timeout reached... marking transition complete. tengine[2002]: 2007/09/19_19:34:22 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[2002]: 2007/09/19_19:34:22 info: update_abort_priority: 'Event failed' abort superceeded tengine[2002]: 2007/09/19_19:34:22 WARN: global_timer_callback: Writing 1 unconfirmed actions to the CIB tengine[2002]: 2007/09/19_19:34:22 info: unconfirmed_actions: Action do_shutdown 17 unconfirmed from peer tengine[2002]: 2007/09/19_19:34:22 ERROR: unconfirmed_actions: Waiting on 1 unconfirmed actions pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' crmd[745]: 2007/09/19_19:34:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:34:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:34:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: determine_online_status: Node host-2.awale.qc.ca is shutting down tengine[2002]: 2007/09/19_19:34:22 info: unpack_graph: Unpacked transition 265: 11 actions in 11 synapses pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 4: share-drbd_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 5: share-drbdlinks_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 6: share-FS_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 7: vmstat-mon_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 8: mysql_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 9: msg_first_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 10: msg_last_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:34:22 info: send_rsc_command: Initiating action 11: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped tengine[2002]: 2007/09/19_19:34:22 info: te_crm_command: Executing crm-event (17): do_shutdown on host-2.awale.qc.ca pengine[2003]: 2007/09/19_19:34:22 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:34:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:34:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:34:22 WARN: custom_action: Action share-drbd_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:34:22 WARN: custom_action: Action share-drbdlinks_monitor_0 (unmanaged) pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:34:22 WARN: custom_action: Action share-drbd_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:34:22 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[2003]: 2007/09/19_19:34:22 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:34:22 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:34:22 WARN: process_pe_message: Transition 265: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-187.bz2 pengine[2003]: 2007/09/19_19:34:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[728]: 2007/09/19_19:34:33 WARN: node host-2.awale.qc.ca: is dead crmd[745]: 2007/09/19_19:34:33 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] cibmon[739]: 2007/09/19_19:34:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:34:33 info: te_update_diff: Aborting on transient_attributes deletions cibmon[739]: 2007/09/19_19:34:33 info: log_cib_diff: cib_update: Local-only Change: 0.87.23 tengine[2002]: 2007/09/19_19:34:33 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:34:33 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:34:33 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[745]: 2007/09/19_19:34:33 info: mem_handle_event: no mbr_track info cib[741]: 2007/09/19_19:34:33 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[745]: 2007/09/19_19:34:33 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[741]: 2007/09/19_19:34:33 info: mem_handle_event: no mbr_track info crmd[745]: 2007/09/19_19:34:33 info: mem_handle_event: instance=13, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[741]: 2007/09/19_19:34:33 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[745]: 2007/09/19_19:34:33 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=13) ccm[740]: 2007/09/19_19:34:33 info: Break tie for 2 nodes cluster cib[741]: 2007/09/19_19:34:33 info: mem_handle_event: instance=13, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[745]: 2007/09/19_19:34:33 info: ccm_event_detail: NEW MEMBERSHIP: trans=13, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cib[741]: 2007/09/19_19:34:33 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[745]: 2007/09/19_19:34:33 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=13] cib[741]: 2007/09/19_19:34:33 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:34:33 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=12] cibmon[739]: 2007/09/19_19:34:33 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:34:33 info: log_cib_diff: cib_update: Local-only Change: 0.87.23 cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:34:33 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 4]: In-flight (id: share-drbd_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 5]: In-flight (id: share-drbdlinks_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 6]: In-flight (id: share-FS_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 7]: In-flight (id: vmstat-mon_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 8]: In-flight (id: mysql_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 9]: In-flight (id: msg_first_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 10]: In-flight (id: msg_last_monitor_0, loc: host-2.awale.qc.ca, priority: 0) tengine[2002]: 2007/09/19_19:34:42 WARN: action_timer_callback: Timer popped (abort_level=1000000, complete=false) tengine[2002]: 2007/09/19_19:34:42 WARN: print_elem: Action missed its timeout[Action 11]: In-flight (id: IPaddr_10_0_0_59_monitor_0, loc: host-2.awale.qc.ca, priority: 0) cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x95bc760(602 777)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=621ed809-ff1c-4728-986b-8802deb60c6b] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7313] cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: - cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: cibmon_diff: [cib_diff_notify] cib_create confirmed cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_cib_diff: cib_create: Diff: --- 0.87.23 cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_cib_diff: cib_create: Diff: +++ 0.88.1 cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: - cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[741]: 2007/09/19_19:34:51 info: log_data_element: cib:diff: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cibmon[739]: 2007/09/19_19:34:51 info: log_data_element: cib_create: + cib[7315]: 2007/09/19_19:34:51 info: write_cib_contents: Wrote version 0.88.1 of the CIB to disk (digest: 0a752a51cc48eba0463e5e3f3d6ab8ff) cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x95cb4e8(440 559)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=fc273a14-b01e-4fa5-8723-d0412de61ad1] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7316] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x95e2fd0(570 716)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=787680b9-23f9-4518-81b6-d6beb0ab9bca] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7317] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x9567860(736 932)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=8d0f6175-21aa-47c0-b7be-c7770c4b7322] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7318] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x95a4fa0(770 978)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=2c8fce88-4491-40b3-aab2-42c00d2cc262] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7319] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x9562fa0(434 553)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=e3fd56a0-4376-4c86-840b-f49752c57ba4] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7320] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x9581a90(429 548)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=f9081630-5343-4b0f-a399-499573d433d4] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7321] cib[741]: 2007/09/19_19:34:51 WARN: update_results: Action add failed: The object already exists (cde=-21) cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 ERROR: log_data_element: cib_process_change: CIB Update failures cib[741]: 2007/09/19_19:34:51 WARN: do_cib_notify: cib_create of FAILED: The object already exists cib[741]: 2007/09/19_19:34:51 ERROR: cib_process_request: cib_create operation failed: The object already exists cib[741]: 2007/09/19_19:34:51 info: crm_log_message_adv: #========= Input message message start ==========# cib[741]: 2007/09/19_19:34:51 info: MSG: Dumping message with 9 fields cib[741]: 2007/09/19_19:34:51 info: MSG[0] : [__name__=cib_command] cib[741]: 2007/09/19_19:34:51 info: MSG[1] : [t=cib] cib[741]: 2007/09/19_19:34:51 info: MSG[2] : [cib_op=cib_create] cib[741]: 2007/09/19_19:34:51 info: MSG[3] : [cib_section=resources] cib[741]: 2007/09/19_19:34:51 info: MSG[4] : [cib_callid=2] cib[741]: 2007/09/19_19:34:51 info: MSG[5] : [cib_callopt=0] cib[741]: 2007/09/19_19:34:51 info: MSG[6] : [(2)cib_calldata=0x95a89b8(461 582)] cib[741]: 2007/09/19_19:34:51 info: cib[741]: 2007/09/19_19:34:51 info: MSG[7] : [cib_clientid=d8570494-479f-4214-b1ba-22e782cd08c2] cib[741]: 2007/09/19_19:34:51 info: MSG[8] : [cib_clientname=7322] cib[741]: 2007/09/19_19:35:54 info: cib_stats: Processed 213 operations (9342.00us average, 0% utilization) in the last 10min crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:36:02 WARN: global_timer_callback: Timer popped (abort_level=1000000, complete=false) crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-drbd_monitor_0 4 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-drbdlinks_monitor_0 5 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-FS_monitor_0 6 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action vmstat-mon_monitor_0 7 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action mysql_monitor_0 8 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action msg_first_monitor_0 9 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action msg_last_monitor_0 10 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action IPaddr_10_0_0_59_monitor_0 11 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 ERROR: unconfirmed_actions: Waiting on 8 unconfirmed actions tengine[2002]: 2007/09/19_19:36:02 WARN: global_timer_callback: Transition abort timeout reached... marking transition complete. tengine[2002]: 2007/09/19_19:36:02 WARN: global_timer_callback: Writing 8 unconfirmed actions to the CIB tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-drbd_monitor_0 4 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 4: share-drbd_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-drbdlinks_monitor_0 5 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 5: share-drbdlinks_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action share-FS_monitor_0 6 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 6: share-FS_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action vmstat-mon_monitor_0 7 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 7: vmstat-mon_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action mysql_monitor_0 8 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 8: mysql_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action msg_first_monitor_0 9 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 9: msg_first_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action msg_last_monitor_0 10 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 10: msg_last_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 info: unconfirmed_actions: Action IPaddr_10_0_0_59_monitor_0 11 unconfirmed from peer tengine[2002]: 2007/09/19_19:36:02 WARN: cib_action_update: rsc_op 11: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca timed out tengine[2002]: 2007/09/19_19:36:02 ERROR: unconfirmed_actions: Waiting on 8 unconfirmed actions cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.1 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.2 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: unpack_graph: Unpacked transition 266: 8 actions in 8 synapses pengine[2003]: 2007/09/19_19:36:02 info: determine_online_status: Node host-1.awale.qc.ca is online cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action share-drbd_monitor_0 from a different transition: 265 vs. 266 pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: update_abort_priority: Abort action 0 superceeded by 2 pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: run_graph: ==================================================== pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 notice: run_graph: Transition 266: (Complete=0, Pending=0, Fired=0, Skipped=6, Incomplete=2) pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-drbd (heartbeat:drbddisk): Stopped cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:36:02 info: clone_print: Clone Set: DoFencing pengine[2003]: 2007/09/19_19:36:02 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource msg_last cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.2 pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource msg_first cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.3 pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource mysql cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action share-drbdlinks_monitor_0 from a different transition: 265 vs. 266 pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-FS cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-drbdlinks cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-drbd cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: StartRsc: host-1.awale.qc.ca Start child_DoFencing:0 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_50000 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 WARN: process_pe_message: Transition 266: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-188.bz2 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - pengine[2003]: 2007/09/19_19:36:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.3 tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action share-FS_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.4 tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action vmstat-mon_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.4 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.5 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action mysql_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.5 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.6 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action msg_first_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.6 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.7 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action msg_last_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.7 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.8 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: process_graph_event: Detected action IPaddr_10_0_0_59_monitor_0 from a different transition: 265 vs. 266 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 WARN: notify_crmd: Delaying completion until all CIB updates complete cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.8 crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.9 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[745]: 2007/09/19_19:36:02 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[2003]: 2007/09/19_19:36:02 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[2003]: 2007/09/19_19:36:02 info: determine_online_status: Node host-1.awale.qc.ca is online tengine[2002]: 2007/09/19_19:36:02 info: unpack_graph: Unpacked transition 267: 8 actions in 8 synapses pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:36:02 info: send_rsc_command: Initiating action 4: child_DoFencing:0_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:36:02 info: send_rsc_command: Initiating action 5: child_DoFencing:1_monitor_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:36:02 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:36:02 info: clone_print: Clone Set: DoFencing pengine[2003]: 2007/09/19_19:36:02 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Stopped pengine[2003]: 2007/09/19_19:36:02 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[2003]: 2007/09/19_19:36:02 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[2003]: 2007/09/19_19:36:02 notice: StartRsc: host-1.awale.qc.ca Start child_DoFencing:0 pengine[2003]: 2007/09/19_19:36:02 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_50000 pengine[2003]: 2007/09/19_19:36:02 WARN: process_pe_message: Transition 267: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-189.bz2 pengine[2003]: 2007/09/19_19:36:02 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[745]: 2007/09/19_19:36:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_0 key=4:267:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:36:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:1_monitor_0 key=5:267:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:36:02 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_0 (call=69, rc=7) complete crmd[745]: 2007/09/19_19:36:02 info: process_lrm_event: LRM operation child_DoFencing:1_monitor_0 (call=70, rc=7) complete cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:36:02 info: match_graph_event: Action child_DoFencing:0_monitor_0 (4) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.9 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.10 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.10 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.11 tengine[2002]: 2007/09/19_19:36:02 info: match_graph_event: Action child_DoFencing:1_monitor_0 (5) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:36:02 info: send_rsc_command: Initiating action 3: probe_complete on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: te_pseudo_action: Pseudo action 2 fired and confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: te_pseudo_action: Pseudo action 10 fired and confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:02 info: send_rsc_command: Initiating action 8: child_DoFencing:0_start_0 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:36:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=8:267:2974a93a-aeed-4483-8a7a-4557ddb8520f) cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_modify: Diff: --- 0.88.11 cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_modify: Diff: +++ 0.88.12 cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_modify: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_modify: + lrmd[7343]: 2007/09/19_19:36:02 info: Try to start STONITH resource : Device=apcsnmp stonithd[7344]: 2007/09/19_19:36:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7344]: 2007/09/19_19:36:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[745]: 2007/09/19_19:36:02 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=71, rc=0) complete crmd[745]: 2007/09/19_19:36:02 info: build_operation_update: Digest for 0:0;8:267:2974a93a-aeed-4483-8a7a-4557ddb8520f (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[745]: 2007/09/19_19:36:02 info: log_data_element: build_operation_update: digest:source lrmd[742]: 2007/09/19_19:36:02 WARN: stonithRA plugin: cannot get shortdesc segment of apcsnmp's metadata. stonithd[743]: 2007/09/19_19:36:02 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cibmon[739]: 2007/09/19_19:36:02 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[2002]: 2007/09/19_19:36:02 info: match_graph_event: Action child_DoFencing:0_start_0 (8) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: --- 0.88.12 tengine[2002]: 2007/09/19_19:36:02 info: send_rsc_command: Initiating action 9: child_DoFencing:0_monitor_50000 on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:02 info: log_cib_diff: cib_update: Diff: +++ 0.88.13 crmd[745]: 2007/09/19_19:36:02 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_50000 key=9:267:2974a93a-aeed-4483-8a7a-4557ddb8520f) tengine[2002]: 2007/09/19_19:36:02 info: te_pseudo_action: Pseudo action 11 fired and confirmed cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:02 info: log_data_element: cib_update: + stonithd[743]: 2007/09/19_19:36:02 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[743]: 2007/09/19_19:36:03 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 360 ms (> 30 ms) (GSource: 0x9af4cf0) stonithd[7346]: 2007/09/19_19:36:03 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7346]: 2007/09/19_19:36:03 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[745]: 2007/09/19_19:36:03 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=72, rc=0) complete cibmon[739]: 2007/09/19_19:36:03 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:36:03 info: log_cib_diff: cib_update: Diff: --- 0.88.13 cibmon[739]: 2007/09/19_19:36:03 info: log_cib_diff: cib_update: Diff: +++ 0.88.14 cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:03 info: match_graph_event: Action child_DoFencing:0_monitor_50000 (9) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:36:03 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:36:03 info: run_graph: Transition 267: (Complete=8, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:36:03 info: notify_crmd: Transition 267 status: te_complete - cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:36:03 info: log_data_element: cib_update: + stonithd[7360]: 2007/09/19_19:36:53 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7360]: 2007/09/19_19:36:53 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[743]: 2007/09/19_19:36:53 WARN: Performed 2 more non-realtime malloc calls. stonithd[743]: 2007/09/19_19:36:53 info: Total non-realtime malloc bytes: 274432 heartbeat[728]: 2007/09/19_19:37:28 info: killing /usr/lib/heartbeat/mgmtd -v process group 746 with signal 15 mgmtd[746]: 2007/09/19_19:37:28 info: mgmtd is shutting down heartbeat[728]: 2007/09/19_19:37:28 info: killing /usr/lib/heartbeat/crmd process group 745 with signal 15 crmd[745]: 2007/09/19_19:37:28 info: crm_shutdown: Requesting shutdown crmd[745]: 2007/09/19_19:37:28 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] crmd[745]: 2007/09/19_19:37:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. crmd[745]: 2007/09/19_19:37:28 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[745]: 2007/09/19_19:37:28 info: do_shutdown_req: Processing shutdown locally crmd[745]: 2007/09/19_19:37:28 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca tengine[2002]: 2007/09/19_19:37:28 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 tengine[2002]: 2007/09/19_19:37:28 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:37:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_update: Diff: --- 0.88.14 cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.15 cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_update: + pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' crmd[745]: 2007/09/19_19:37:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[2002]: 2007/09/19_19:37:28 info: unpack_graph: Unpacked transition 268: 5 actions in 5 synapses pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[2002]: 2007/09/19_19:37:28 info: send_rsc_command: Initiating action 5: vmstat-mon_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' tengine[2002]: 2007/09/19_19:37:28 info: te_pseudo_action: Pseudo action 9 fired and confirmed pengine[2003]: 2007/09/19_19:37:28 info: determine_online_status: Node host-1.awale.qc.ca is shutting down tengine[2002]: 2007/09/19_19:37:28 info: send_rsc_command: Initiating action 6: child_DoFencing:0_stop_0 on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 WARN: unpack_rsc_op: Processing failed op (share-drbd_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 WARN: unpack_rsc_op: Handling failed stop for share-drbd on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: msg_first (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[2003]: 2007/09/19_19:37:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[2003]: 2007/09/19_19:37:28 info: clone_print: Clone Set: DoFencing pengine[2003]: 2007/09/19_19:37:28 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[2003]: 2007/09/19_19:37:28 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource msg_last cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource msg_first cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource mysql cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource share-FS cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource share-drbd cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource vmstat-mon cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource child_DoFencing:0 cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[2003]: 2007/09/19_19:37:28 notice: StopRsc: host-1.awale.qc.ca Stop child_DoFencing:0 pengine[2003]: 2007/09/19_19:37:28 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[2003]: 2007/09/19_19:37:28 WARN: process_pe_message: Transition 268: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-190.bz2 pengine[2003]: 2007/09/19_19:37:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[745]: 2007/09/19_19:37:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=5:268:2974a93a-aeed-4483-8a7a-4557ddb8520f) crmd[745]: 2007/09/19_19:37:28 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_stop_0 key=6:268:2974a93a-aeed-4483-8a7a-4557ddb8520f) lrmd[7376]: 2007/09/19_19:37:28 info: Try to stop STONITH resource : Device=apcsnmp crmd[745]: 2007/09/19_19:37:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=34, rc=-2) Cancelled crmd[745]: 2007/09/19_19:37:28 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=72, rc=-2) Cancelled cibmon[739]: 2007/09/19_19:37:28 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_delete: Diff: --- 0.88.15 cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_delete: Diff: +++ 0.88.16 cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: + daemontools[7375][7386]: 2007/09/19_19:37:28 INFO Stoping vmstat-mon cibmon[739]: 2007/09/19_19:37:28 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_delete: Diff: --- 0.88.16 cibmon[739]: 2007/09/19_19:37:28 info: log_cib_diff: cib_delete: Diff: +++ 0.88.17 cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: - cibmon[739]: 2007/09/19_19:37:28 info: log_data_element: cib_delete: + crmd[745]: 2007/09/19_19:37:28 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=73, rc=0) complete crmd[745]: 2007/09/19_19:37:28 info: process_lrm_event: LRM operation child_DoFencing:0_stop_0 (call=74, rc=0) complete cibmon[739]: 2007/09/19_19:37:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:37:29 info: log_cib_diff: cib_update: Diff: --- 0.88.17 cibmon[739]: 2007/09/19_19:37:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.18 cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:37:29 info: match_graph_event: Action vmstat-mon_stop_0 (5) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + cibmon[739]: 2007/09/19_19:37:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[739]: 2007/09/19_19:37:29 info: log_cib_diff: cib_update: Diff: --- 0.88.18 cibmon[739]: 2007/09/19_19:37:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.19 cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: - tengine[2002]: 2007/09/19_19:37:29 info: match_graph_event: Action child_DoFencing:0_stop_0 (6) confirmed on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + tengine[2002]: 2007/09/19_19:37:29 info: te_pseudo_action: Pseudo action 10 fired and confirmed cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: handle_request: Shutting ourselves down (DC) tengine[2002]: 2007/09/19_19:37:29 info: te_crm_command: Executing crm-event (11): do_shutdown on host-1.awale.qc.ca cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ] tengine[2002]: 2007/09/19_19:37:29 info: te_crm_command: Skipping wait for 11 cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: do_dc_release: DC role released tengine[2002]: 2007/09/19_19:37:29 info: run_graph: Transition 268: (Complete=5, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to pengine: [2003] tengine[2002]: 2007/09/19_19:37:29 info: notify_crmd: Transition 268 status: te_complete - cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to tengine: [2002] tengine[2002]: 2007/09/19_19:37:29 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Terminating the pengine tengine[2002]: 2007/09/19_19:37:29 info: update_abort_priority: Abort action 2 superceeded by 3 cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to pengine: [2003] tengine[2002]: 2007/09/19_19:37:29 info: notify_crmd: Exiting after transition pengine[2003]: 2007/09/19_19:37:29 info: pengine_shutdown: Exiting PEngine (SIGTERM) cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Terminating the tengine tengine[2002]: 2007/09/19_19:37:29 info: te_init: Exiting tengine cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to tengine: [2002] cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Waiting for subsystems to exit cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[739]: 2007/09/19_19:37:29 info: log_data_element: cib_update: + crmd[745]: 2007/09/19_19:37:29 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Terminating the pengine crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to pengine: [2003] crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Terminating the tengine crmd[745]: 2007/09/19_19:37:29 info: stop_subsystem: Sent -TERM to tengine: [2002] crmd[745]: 2007/09/19_19:37:29 info: do_shutdown: Waiting for subsystems to exit crmd[745]: 2007/09/19_19:37:29 info: crmdManagedChildDied: Process tengine:[2002] exited (signal=0, exitcode=0) crmd[745]: 2007/09/19_19:37:29 info: crmdManagedChildDied: Process pengine:[2003] exited (signal=0, exitcode=0) crmd[745]: 2007/09/19_19:37:29 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[745]: 2007/09/19_19:37:29 info: verify_stopped: Checking for active resources before exit ccm[740]: 2007/09/19_19:37:29 info: client (pid=745) removed from ccm crmd[745]: 2007/09/19_19:37:29 info: verify_stopped: Checking for active resources before exit crmd[745]: 2007/09/19_19:37:29 info: do_lrm_control: Disconnected from the LRM crmd[745]: 2007/09/19_19:37:29 info: do_ha_control: Disconnected from Heartbeat crmd[745]: 2007/09/19_19:37:29 info: do_cib_control: Disconnecting CIB cib[741]: 2007/09/19_19:37:29 info: cib_process_readwrite: We are now in R/O mode crmd[745]: 2007/09/19_19:37:29 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[745]: 2007/09/19_19:37:29 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[745]: 2007/09/19_19:37:29 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[745]: 2007/09/19_19:37:29 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[745]: 2007/09/19_19:37:29 info: do_exit: [crmd] stopped (0) heartbeat[728]: 2007/09/19_19:37:29 info: killing /usr/lib/heartbeat/attrd process group 744 with signal 15 attrd[744]: 2007/09/19_19:37:29 info: attrd_shutdown: Exiting attrd[744]: 2007/09/19_19:37:29 info: main: Exiting... heartbeat[728]: 2007/09/19_19:37:29 info: killing /usr/lib/heartbeat/stonithd process group 743 with signal 15 stonithd[743]: 2007/09/19_19:37:29 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[728]: 2007/09/19_19:37:29 info: killing /usr/lib/heartbeat/lrmd -r process group 742 with signal 15 lrmd[742]: 2007/09/19_19:37:29 info: lrmd is shutting down heartbeat[728]: 2007/09/19_19:37:29 info: killing /usr/lib/heartbeat/cib process group 741 with signal 15 cib[741]: 2007/09/19_19:37:29 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[741]: 2007/09/19_19:37:29 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[739]: 2007/09/19_19:37:29 ERROR: cib_native_msgready: Message pending on command channel [741] cib[741]: 2007/09/19_19:37:29 info: cib_shutdown: Disconnected 2 clients cibmon[739]: 2007/09/19_19:37:29 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========# cib[741]: 2007/09/19_19:37:29 info: cib_process_disconnect: All clients disconnected... cibmon[739]: 2007/09/19_19:37:29 ERROR: MSG: No message to dump cib[741]: 2007/09/19_19:37:29 info: initiate_exit: Sending disconnect notification to 2 peers... cibmon[739]: 2007/09/19_19:37:29 info: cib_native_msgready: Lost connection to the CIB service [741]. cibmon[739]: 2007/09/19_19:37:29 CRIT: cib_native_dispatch: Lost connection to the CIB service [741/callback]. cibmon[739]: 2007/09/19_19:37:29 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[741]: 2007/09/19_19:37:34 notice: cib_force_exit: Forcing exit! cib[741]: 2007/09/19_19:37:34 info: terminate_ha_connection: cib_force_exit: Disconnecting heartbeat cib[741]: 2007/09/19_19:37:34 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[741]: 2007/09/19_19:37:34 info: main: Done ccm[740]: 2007/09/19_19:37:34 info: client (pid=741) removed from ccm heartbeat[728]: 2007/09/19_19:37:34 info: killing /usr/lib/heartbeat/ccm process group 740 with signal 15 ccm[740]: 2007/09/19_19:37:34 info: received SIGTERM, going to shut down heartbeat[728]: 2007/09/19_19:37:34 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[728]: 2007/09/19_19:37:35 info: killing HBFIFO process 732 with signal 15 heartbeat[728]: 2007/09/19_19:37:35 info: killing HBWRITE process 733 with signal 15 heartbeat[728]: 2007/09/19_19:37:35 info: killing HBREAD process 734 with signal 15 heartbeat[728]: 2007/09/19_19:37:35 info: killing HBWRITE process 735 with signal 15 heartbeat[728]: 2007/09/19_19:37:35 info: killing HBREAD process 736 with signal 15 heartbeat[728]: 2007/09/19_19:37:35 info: Core process 733 exited. 5 remaining heartbeat[728]: 2007/09/19_19:37:35 info: Core process 734 exited. 4 remaining heartbeat[728]: 2007/09/19_19:37:35 info: Core process 732 exited. 3 remaining heartbeat[728]: 2007/09/19_19:37:35 info: Core process 735 exited. 2 remaining heartbeat[728]: 2007/09/19_19:37:35 info: Core process 736 exited. 1 remaining heartbeat[728]: 2007/09/19_19:37:35 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[710]: 2007/09/19_19:37:35 info: logd_term_write_action: received SIGTERM logd[710]: 2007/09/19_19:37:35 info: Exiting write process logd[7411]: 2007/09/19_19:37:48 info: logd started with /etc/logd.cf. logd[7412]: 2007/09/19_19:37:48 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[7411]: 2007/09/19_19:37:48 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7432]: 2007/09/19_19:37:48 info: No log entry found in ha.cf -- use logd heartbeat[7432]: 2007/09/19_19:37:48 info: Enabling logging daemon heartbeat[7432]: 2007/09/19_19:37:48 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[7432]: 2007/09/19_19:37:48 info: ************************** heartbeat[7432]: 2007/09/19_19:37:48 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[7433]: 2007/09/19_19:37:48 info: heartbeat: version 2.1.2 heartbeat[7433]: 2007/09/19_19:37:48 info: Heartbeat generation: 1188360851 heartbeat[7433]: 2007/09/19_19:37:48 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7433]: 2007/09/19_19:37:48 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[7433]: 2007/09/19_19:37:48 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[7433]: 2007/09/19_19:37:48 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[7433]: 2007/09/19_19:37:48 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[7433]: 2007/09/19_19:37:48 info: glib: ping group heartbeat started. heartbeat[7433]: 2007/09/19_19:37:48 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[7433]: 2007/09/19_19:37:48 info: Local status now set to: 'up' heartbeat[7433]: 2007/09/19_19:37:50 info: Link local:local up. heartbeat[7433]: 2007/09/19_19:37:50 info: Status update for node local: status ping heartbeat[7433]: 2007/09/19_19:37:50 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[7433]: 2007/09/19_19:38:09 WARN: node host-2.awale.qc.ca: is dead heartbeat[7433]: 2007/09/19_19:38:09 info: Comm_now_up(): updating status to active heartbeat[7433]: 2007/09/19_19:38:09 info: Local status now set to: 'active' heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[7446]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 7446) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[7433]: 2007/09/19_19:38:09 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[7447]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 7447) heartbeat[7448]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 7448) cibmon[7446]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[7449]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 7449) heartbeat[7451]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 7451) heartbeat[7450]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 7450) heartbeat[7452]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 7452) heartbeat[7453]: 2007/09/19_19:38:09 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 7453) stonithd[7450]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[7450]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[7448]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7448]: 2007/09/19_19:38:09 info: G_main_add_TriggerHandler: Added signal manual handler cib[7448]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7448]: 2007/09/19_19:38:09 info: main: Retrieval of a per-action CIB: disabled cib[7448]: 2007/09/19_19:38:09 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] ccm[7447]: 2007/09/19_19:38:09 info: Hostname: host-1.awale.qc.ca cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] lrmd[7449]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] lrmd[7449]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] lrmd[7449]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 10 cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] lrmd[7449]: 2007/09/19_19:38:09 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] lrmd[7449]: 2007/09/19_19:38:09 info: Started. cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: log_data_element: readCibXmlFile: [on-disk] cib[7448]: 2007/09/19_19:38:09 info: startCib: CIB Initialization completed successfully cib[7448]: 2007/09/19_19:38:09 info: cib_register_ha: Signing in with Heartbeat cib[7448]: 2007/09/19_19:38:09 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[7448]: 2007/09/19_19:38:09 WARN: cib_init: CCM Activation failed cib[7448]: 2007/09/19_19:38:09 WARN: cib_init: CCM Connection failed 1 times (30 max) crmd[7452]: 2007/09/19_19:38:10 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[7452]: 2007/09/19_19:38:10 info: crmd_init: Starting crmd crmd[7452]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[7452]: 2007/09/19_19:38:10 info: G_main_add_TriggerHandler: Added signal manual handler crmd[7452]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[7451]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[7451]: 2007/09/19_19:38:10 info: register_with_ha: Hostname: host-1.awale.qc.ca mgmtd[7453]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[7453]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[7453]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 12 attrd[7451]: 2007/09/19_19:38:10 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[7453]: 2007/09/19_19:38:10 info: init_crm stonithd[7450]: 2007/09/19_19:38:10 info: Signing in with heartbeat. ccm[7447]: 2007/09/19_19:38:10 info: Break tie for 2 nodes cluster ccm[7447]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 stonithd[7450]: 2007/09/19_19:38:10 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[7450]: 2007/09/19_19:38:10 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[7448]: 2007/09/19_19:38:11 info: cib_init: Starting cib mainloop cib[7448]: 2007/09/19_19:38:11 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[7448]: 2007/09/19_19:38:11 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[7448]: 2007/09/19_19:38:11 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:11 info: main: Starting mainloop crmd[7452]: 2007/09/19_19:38:11 info: do_cib_control: CIB connection established cib[7448]: 2007/09/19_19:38:11 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on cib[7448]: 2007/09/19_19:38:11 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on crmd[7452]: 2007/09/19_19:38:11 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[7448]: 2007/09/19_19:38:11 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] cib[7448]: 2007/09/19_19:38:11 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[7448]: 2007/09/19_19:38:11 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[7454]: 2007/09/19_19:38:11 info: write_cib_contents: Wrote version 0.88.1 of the CIB to disk (digest: bf28110d4c10532e265e6823ce1af0bb) crmd[7452]: 2007/09/19_19:38:11 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[7453]: 2007/09/19_19:38:11 info: Started. crmd[7452]: 2007/09/19_19:38:11 info: populate_cib_nodes: Requesting the list of configured nodes crmd[7452]: 2007/09/19_19:38:12 WARN: get_uuid: Could not calculate UUID for host-2.awale.qc.ca crmd[7452]: 2007/09/19_19:38:12 WARN: populate_cib_nodes: Node host-2.awale.qc.ca: no uuid found crmd[7452]: 2007/09/19_19:38:12 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[7452]: 2007/09/19_19:38:12 info: do_ha_control: Connected to Heartbeat crmd[7452]: 2007/09/19_19:38:12 info: do_ccm_control: CCM connection established... waiting for first callback crmd[7452]: 2007/09/19_19:38:12 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[7452]: 2007/09/19_19:38:12 info: crmd_init: Starting crmd's mainloop crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' crmd[7452]: 2007/09/19_19:38:12 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' crmd[7452]: 2007/09/19_19:38:12 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[7452]: 2007/09/19_19:38:12 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[7446]: 2007/09/19_19:38:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:13 info: log_cib_diff: cib_update: Local-only Change: 0.88.1 cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:13 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[7452]: 2007/09/19_19:38:13 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[7452]: 2007/09/19_19:38:13 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[7452]: 2007/09/19_19:38:13 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[7452]: 2007/09/19_19:38:13 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[7452]: 2007/09/19_19:38:13 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7452]: 2007/09/19_19:38:13 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=1] crmd[7452]: 2007/09/19_19:38:13 info: do_started: The local CRM is operational crmd[7452]: 2007/09/19_19:38:13 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] crmd[7452]: 2007/09/19_19:38:13 info: update_dc: Set DC to () cibmon[7446]: 2007/09/19_19:38:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:13 info: log_cib_diff: cib_update: Local-only Change: 0.88.1 cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:13 info: log_data_element: cib_update: + attrd[7451]: 2007/09/19_19:38:16 info: main: Starting mainloop... crmd[7452]: 2007/09/19_19:38:24 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[7452]: 2007/09/19_19:38:24 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[7452]: 2007/09/19_19:38:24 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[7452]: 2007/09/19_19:38:24 info: update_dc: Set DC to () crmd[7452]: 2007/09/19_19:38:24 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[7452]: 2007/09/19_19:38:24 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[7452]: 2007/09/19_19:38:24 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[7452]: 2007/09/19_19:38:24 info: start_subsystem: Starting sub-system "tengine" crmd[7452]: 2007/09/19_19:38:24 info: start_subsystem: Starting sub-system "pengine" crmd[7452]: 2007/09/19_19:38:24 info: do_dc_takeover: Taking over DC status for this partition cib[7448]: 2007/09/19_19:38:24 info: cib_process_readwrite: We are now in R/W mode tengine[7456]: 2007/09/19_19:38:24 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[7456]: 2007/09/19_19:38:24 info: G_main_add_TriggerHandler: Added signal manual handler cibmon[7446]: 2007/09/19_19:38:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:24 info: log_cib_diff: cib_update: Diff: --- 0.88.1 cibmon[7446]: 2007/09/19_19:38:24 info: log_cib_diff: cib_update: Diff: +++ 0.88.2 cibmon[7446]: 2007/09/19_19:38:24 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:24 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:24 info: update_dc: Set DC to () crmd[7452]: 2007/09/19_19:38:24 info: join_make_offer: Making join offers based on membership 1 crmd[7452]: 2007/09/19_19:38:24 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks pengine[7457]: 2007/09/19_19:38:24 info: G_main_add_SignalHandler: Added signal handler for signal 15 pengine[7457]: 2007/09/19_19:38:24 info: pe_init: Starting pengine cib[7448]: 2007/09/19_19:38:24 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[7456]: 2007/09/19_19:38:24 info: te_init: Registering TE UUID: b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 tengine[7456]: 2007/09/19_19:38:24 info: set_graph_functions: Setting custom graph functions tengine[7456]: 2007/09/19_19:38:24 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[7456]: 2007/09/19_19:38:24 info: te_init: Starting tengine crmd[7452]: 2007/09/19_19:38:24 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7452]: 2007/09/19_19:38:25 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] cib[7448]: 2007/09/19_19:38:25 info: sync_our_cib: Syncing CIB to all peers crmd[7452]: 2007/09/19_19:38:25 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[7452]: 2007/09/19_19:38:25 info: update_attrd: Connecting to attrd... attrd[7451]: 2007/09/19_19:38:25 info: attrd_local_callback: Sending full refresh cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.2 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.3 crmd[7452]: 2007/09/19_19:38:25 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.3 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.4 cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:25 info: do_dc_join_ack: join-1: Updating node state to member for host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.4 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.5 cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:25 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:25 info: do_state_transition: All 1 cluster nodes are eligible to run resources. tengine[7456]: 2007/09/19_19:38:25 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[7456]: 2007/09/19_19:38:25 info: update_abort_priority: 'DC Takeover' abort superceeded pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:38:25 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:38:25 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:38:25 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: vmstat-mon (heartbeat:daemontools): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: msg_first (heartbeat:msg): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: msg_last (heartbeat:msg): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[7457]: 2007/09/19_19:38:25 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:38:25 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:38:25 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:38:25 WARN: native_assign_node: 2 nodes with equal score (+INFINITY) for running the listed resources (chose host-1.awale.qc.ca): pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start vmstat-mon pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:38:25 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[7457]: 2007/09/19_19:38:25 notice: StartRsc: host-1.awale.qc.ca Start child_DoFencing:0 pengine[7457]: 2007/09/19_19:38:25 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_50000 crmd[7452]: 2007/09/19_19:38:25 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:38:25 WARN: process_pe_message: Transition 0: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-191.bz2 pengine[7457]: 2007/09/19_19:38:25 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. tengine[7456]: 2007/09/19_19:38:25 info: unpack_graph: Unpacked transition 0: 32 actions in 32 synapses tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 3: share-drbd_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 4: share-drbdlinks_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 5: share-FS_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 6: vmstat-mon_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 7: mysql_monitor_0 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_0 key=3:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 8: msg_first_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 9: msg_last_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 10: IPaddr_10_0_0_59_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 11: child_DoFencing:0_monitor_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:25 info: send_rsc_command: Initiating action 12: child_DoFencing:1_monitor_0 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=4:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=5:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_0 key=6:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=7:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=8:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=9:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=10:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_0 key=11:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: do_lrm_rsc_op: Performing op=child_DoFencing:1_monitor_0 key=12:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:25 info: process_lrm_event: LRM operation share-drbd_monitor_0 (call=2, rc=7) complete cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:25 info: match_graph_event: Action share-drbd_monitor_0 (3) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.5 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.6 cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:25 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=3, rc=7) complete cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:25 info: match_graph_event: Action share-drbdlinks_monitor_0 (4) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.6 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.7 cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:25 info: process_lrm_event: LRM operation vmstat-mon_monitor_0 (call=5, rc=7) complete cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.7 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.8 cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:25 info: match_graph_event: Action vmstat-mon_monitor_0 (6) confirmed on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:25 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=4, rc=7) complete cibmon[7446]: 2007/09/19_19:38:25 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: --- 0.88.8 cibmon[7446]: 2007/09/19_19:38:25 info: log_cib_diff: cib_update: Diff: +++ 0.88.9 tengine[7456]: 2007/09/19_19:38:25 info: match_graph_event: Action share-FS_monitor_0 (5) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:25 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:26 info: process_lrm_event: LRM operation mysql_monitor_0 (call=6, rc=7) complete cibmon[7446]: 2007/09/19_19:38:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: --- 0.88.9 tengine[7456]: 2007/09/19_19:38:26 info: match_graph_event: Action mysql_monitor_0 (7) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: +++ 0.88.10 cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:26 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=7, rc=7) complete cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: --- 0.88.10 tengine[7456]: 2007/09/19_19:38:26 info: match_graph_event: Action msg_first_monitor_0 (8) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: +++ 0.88.11 cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:26 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=8, rc=7) complete crmd[7452]: 2007/09/19_19:38:26 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=9, rc=7) complete cibmon[7446]: 2007/09/19_19:38:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:26 info: match_graph_event: Action msg_last_monitor_0 (9) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: --- 0.88.11 cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: +++ 0.88.12 cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:26 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (10) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: --- 0.88.12 cibmon[7446]: 2007/09/19_19:38:26 info: log_cib_diff: cib_update: Diff: +++ 0.88.13 cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:26 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:27 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_0 (call=10, rc=7) complete crmd[7452]: 2007/09/19_19:38:27 info: process_lrm_event: LRM operation child_DoFencing:1_monitor_0 (call=11, rc=7) complete tengine[7456]: 2007/09/19_19:38:27 info: match_graph_event: Action child_DoFencing:0_monitor_0 (11) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: --- 0.88.13 cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: +++ 0.88.14 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: --- 0.88.14 tengine[7456]: 2007/09/19_19:38:27 info: match_graph_event: Action child_DoFencing:1_monitor_0 (12) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: +++ 0.88.15 tengine[7456]: 2007/09/19_19:38:27 info: send_rsc_command: Initiating action 2: probe_complete on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:27 info: te_pseudo_action: Pseudo action 1 fired and confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:27 info: send_rsc_command: Initiating action 19: vmstat-mon_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:27 info: send_rsc_command: Initiating action 23: msg_first_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:27 info: te_pseudo_action: Pseudo action 31 fired and confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:27 info: send_rsc_command: Initiating action 29: child_DoFencing:0_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:27 info: do_lrm_rsc_op: Performing op=vmstat-mon_start_0 key=19:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:27 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_modify: Diff: --- 0.88.15 cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_modify: Diff: +++ 0.88.16 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: - tengine[7456]: 2007/09/19_19:38:27 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + tengine[7456]: 2007/09/19_19:38:27 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + tengine[7456]: 2007/09/19_19:38:27 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + crmd[7452]: 2007/09/19_19:38:27 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=23:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + crmd[7452]: 2007/09/19_19:38:27 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_start_0 key=29:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_modify: + lrmd[7567]: 2007/09/19_19:38:27 info: Try to start STONITH resource : Device=apcsnmp stonithd[7582]: 2007/09/19_19:38:27 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' msg[7564][7595]: 2007/09/19_19:38:27 INFO Starting to switch to this node. stonithd[7582]: 2007/09/19_19:38:27 info: 10.0.0.166 has sysName 'RackPDU Archivage' msg[7564][7598]: 2007/09/19_19:38:27 INFO Node: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:27 info: process_lrm_event: LRM operation child_DoFencing:0_start_0 (call=14, rc=0) complete crmd[7452]: 2007/09/19_19:38:27 info: build_operation_update: Digest for 0:0;29:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[7452]: 2007/09/19_19:38:27 info: log_data_element: build_operation_update: digest:source daemontools[7563][7597]: 2007/09/19_19:38:27 INFO Starting vmstat-mon lrmd[7449]: 2007/09/19_19:38:27 WARN: stonithRA plugin: cannot get shortdesc segment of apcsnmp's metadata. stonithd[7450]: 2007/09/19_19:38:27 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' cibmon[7446]: 2007/09/19_19:38:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:27 info: match_graph_event: Action child_DoFencing:0_start_0 (29) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: --- 0.88.16 tengine[7456]: 2007/09/19_19:38:27 info: te_pseudo_action: Pseudo action 32 fired and confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: +++ 0.88.17 stonithd[7450]: 2007/09/19_19:38:27 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:27 info: process_lrm_event: LRM operation vmstat-mon_start_0 (call=12, rc=0) complete cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:27 info: build_operation_update: Digest for 0:0;19:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:27 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: --- 0.88.17 cibmon[7446]: 2007/09/19_19:38:27 info: log_cib_diff: cib_update: Diff: +++ 0.88.18 cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:27 info: match_graph_event: Action vmstat-mon_start_0 (19) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:27 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation msg_first_start_0 (call=13, rc=0) complete crmd[7452]: 2007/09/19_19:38:28 info: build_operation_update: Digest for 0:0;23:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[7452]: 2007/09/19_19:38:28 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.18 cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.19 cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action msg_first_start_0 (23) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:28 info: run_graph: ==================================================== cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:38:28 notice: run_graph: Transition 0: (Complete=17, Pending=0, Fired=0, Skipped=15, Incomplete=0) cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:38:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:38:28 info: determine_online_status: Node host-1.awale.qc.ca is online crmd[7452]: 2007/09/19_19:38:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:38:28 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[7457]: 2007/09/19_19:38:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[7457]: 2007/09/19_19:38:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[7457]: 2007/09/19_19:38:28 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[7457]: 2007/09/19_19:38:28 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 info: native_print: msg_last (heartbeat:msg): Stopped tengine[7456]: 2007/09/19_19:38:28 info: unpack_graph: Unpacked transition 1: 15 actions in 15 synapses pengine[7457]: 2007/09/19_19:38:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 3: share-drbd_start_0 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 info: clone_print: Clone Set: DoFencing tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 11: vmstat-mon_monitor_120000 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 12: mysql_start_0 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 16: msg_first_monitor_120000 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 WARN: native_assign_node: 2 nodes with equal score (+INFINITY) for running the listed resources (chose host-1.awale.qc.ca): tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 19: IPaddr_10_0_0_59_start_0 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start share-drbd tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 23: child_DoFencing:0_monitor_50000 on host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca vmstat-mon_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=3:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:38:28 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:38:28 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=vmstat-mon_monitor_120000 key=11:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) pengine[7457]: 2007/09/19_19:38:28 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:38:28 notice: RecurringOp: host-1.awale.qc.ca child_DoFencing:0_monitor_50000 pengine[7457]: 2007/09/19_19:38:28 WARN: process_pe_message: Transition 1: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-192.bz2 pengine[7457]: 2007/09/19_19:38:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=12:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=16:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=19:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=child_DoFencing:0_monitor_50000 key=23:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=16, rc=0) complete cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed stonithd[7450]: 2007/09/19_19:38:28 WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 300 ms (> 30 ms) (GSource: 0x99f9cf0) cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.19 cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.20 cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action vmstat-mon_monitor_120000 (11) confirmed on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation share-drbd_start_0 (call=15, rc=0) complete crmd[7452]: 2007/09/19_19:38:28 info: build_operation_update: Digest for 0:0;3:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[7452]: 2007/09/19_19:38:28 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action share-drbd_start_0 (3) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.20 tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 4: share-drbd_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.21 tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 7: share-FS_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=4:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=7:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=21, rc=0) complete cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action share-drbd_monitor_120000 (4) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.21 cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.22 cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=18, rc=0) complete cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action msg_first_monitor_120000 (16) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.22 cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.23 cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + Filesystem[7651][7718]: 2007/09/19_19:38:28 INFO: Running start for /dev/drbd0 on /share crmd[7452]: 2007/09/19_19:38:28 info: process_lrm_event: LRM operation share-FS_start_0 (call=22, rc=0) complete crmd[7452]: 2007/09/19_19:38:28 info: build_operation_update: Digest for 0:0;7:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[7452]: 2007/09/19_19:38:28 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: --- 0.88.23 cibmon[7446]: 2007/09/19_19:38:28 info: log_cib_diff: cib_update: Diff: +++ 0.88.24 cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:28 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:28 info: match_graph_event: Action share-FS_start_0 (7) confirmed on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 5: share-drbdlinks_start_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:38:28 info: send_rsc_command: Initiating action 8: share-FS_monitor_120000 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=share-drbdlinks_start_0 key=5:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:28 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=8:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:29 info: process_lrm_event: LRM operation share-drbdlinks_start_0 (call=23, rc=0) complete crmd[7452]: 2007/09/19_19:38:29 info: build_operation_update: Digest for 0:0;5:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[7452]: 2007/09/19_19:38:29 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: --- 0.88.24 cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.25 cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:29 info: match_graph_event: Action share-drbdlinks_start_0 (5) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:29 info: send_rsc_command: Initiating action 6: share-drbdlinks_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:29 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_120000 key=6:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:29 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=25, rc=0) complete cibmon[7446]: 2007/09/19_19:38:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: --- 0.88.25 cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.26 cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:29 info: match_graph_event: Action share-drbdlinks_monitor_120000 (6) confirmed on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:29 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=24, rc=0) complete cibmon[7446]: 2007/09/19_19:38:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: --- 0.88.26 cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.27 cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:38:29 info: match_graph_event: Action share-FS_monitor_120000 (8) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + IPaddr[7779][7830]: 2007/09/19_19:38:29 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[7779][7835]: 2007/09/19_19:38:29 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[7779][7857]: 2007/09/19_19:38:29 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[7452]: 2007/09/19_19:38:29 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=19, rc=0) complete crmd[7452]: 2007/09/19_19:38:29 info: build_operation_update: Digest for 0:0;19:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[7452]: 2007/09/19_19:38:29 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:29 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: --- 0.88.27 tengine[7456]: 2007/09/19_19:38:29 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (19) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:29 info: log_cib_diff: cib_update: Diff: +++ 0.88.28 tengine[7456]: 2007/09/19_19:38:29 info: send_rsc_command: Initiating action 20: IPaddr_10_0_0_59_monitor_5000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:29 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=20:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:29 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:30 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=26, rc=0) complete cibmon[7446]: 2007/09/19_19:38:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:30 info: log_cib_diff: cib_update: Diff: --- 0.88.28 cibmon[7446]: 2007/09/19_19:38:30 info: log_cib_diff: cib_update: Diff: +++ 0.88.29 cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:30 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (20) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + stonithd[7902]: 2007/09/19_19:38:30 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[7902]: 2007/09/19_19:38:30 info: 10.0.0.166 has sysName 'RackPDU Archivage' crmd[7452]: 2007/09/19_19:38:30 info: process_lrm_event: LRM operation child_DoFencing:0_monitor_50000 (call=20, rc=0) complete cibmon[7446]: 2007/09/19_19:38:30 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:30 info: log_cib_diff: cib_update: Diff: --- 0.88.29 cibmon[7446]: 2007/09/19_19:38:30 info: log_cib_diff: cib_update: Diff: +++ 0.88.30 tengine[7456]: 2007/09/19_19:38:30 info: match_graph_event: Action child_DoFencing:0_monitor_50000 (23) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:30 info: log_data_element: cib_update: + mysql[7620][7905]: 2007/09/19_19:38:32 INFO: MySQL started crmd[7452]: 2007/09/19_19:38:32 info: process_lrm_event: LRM operation mysql_start_0 (call=17, rc=0) complete crmd[7452]: 2007/09/19_19:38:32 info: build_operation_update: Digest for 0:0;12:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[7452]: 2007/09/19_19:38:32 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: --- 0.88.30 tengine[7456]: 2007/09/19_19:38:32 info: match_graph_event: Action mysql_start_0 (12) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: +++ 0.88.31 tengine[7456]: 2007/09/19_19:38:32 info: send_rsc_command: Initiating action 13: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:32 info: send_rsc_command: Initiating action 17: msg_last_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:32 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=13:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:32 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=17:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:38:32 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=27, rc=0) complete cibmon[7446]: 2007/09/19_19:38:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:38:32 info: match_graph_event: Action mysql_monitor_120000 (13) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: --- 0.88.31 cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: +++ 0.88.32 cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + msg[7915][7943]: 2007/09/19_19:38:32 INFO Completed switching to this node. msg[7915][7944]: 2007/09/19_19:38:32 INFO Node: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:38:32 info: process_lrm_event: LRM operation msg_last_start_0 (call=28, rc=0) complete crmd[7452]: 2007/09/19_19:38:32 info: build_operation_update: Digest for 0:0;17:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[7452]: 2007/09/19_19:38:32 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:38:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: --- 0.88.32 cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: +++ 0.88.33 tengine[7456]: 2007/09/19_19:38:32 info: match_graph_event: Action msg_last_start_0 (17) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:38:32 info: send_rsc_command: Initiating action 18: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:32 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=18:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:38:32 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=29, rc=0) complete cibmon[7446]: 2007/09/19_19:38:32 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[7452]: 2007/09/19_19:38:32 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:38:32 info: match_graph_event: Action msg_last_monitor_120000 (18) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: --- 0.88.33 tengine[7456]: 2007/09/19_19:38:32 info: run_graph: Transition 1: (Complete=15, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[7446]: 2007/09/19_19:38:32 info: log_cib_diff: cib_update: Diff: +++ 0.88.34 tengine[7456]: 2007/09/19_19:38:32 info: notify_crmd: Transition 1 status: te_complete - cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:38:32 info: log_data_element: cib_update: + stonithd[7450]: 2007/09/19_19:39:10 WARN: Performed 2 more non-realtime malloc calls. stonithd[7450]: 2007/09/19_19:39:10 info: Total non-realtime malloc bytes: 294912 stonithd[8107]: 2007/09/19_19:39:20 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8107]: 2007/09/19_19:39:20 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8253]: 2007/09/19_19:40:10 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8253]: 2007/09/19_19:40:10 info: 10.0.0.166 has sysName 'RackPDU Archivage' cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:40:16 info: log_cib_diff: cib_delete: Diff: --- 0.88.34 tengine[7456]: 2007/09/19_19:40:16 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:40:16 info: log_cib_diff: cib_delete: Diff: +++ 0.89.1 crmd[7452]: 2007/09/19_19:40:16 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - crmd[7452]: 2007/09/19_19:40:16 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:16 info: log_data_element: cib_delete: + cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: - cib[7448]: 2007/09/19_19:40:16 info: log_data_element: cib:diff: + pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' crmd[7452]: 2007/09/19_19:40:16 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:40:16 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:40:16 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:40:16 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:40:16 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:16 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:40:16 WARN: native_assign_node: 2 nodes with equal score (+INFINITY) for running the listed resources (chose host-1.awale.qc.ca): pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) tengine[7456]: 2007/09/19_19:40:16 info: unpack_graph: Unpacked transition 2: 0 actions in 0 synapses pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) crmd[7452]: 2007/09/19_19:40:16 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:40:16 info: run_graph: Transition 2: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) tengine[7456]: 2007/09/19_19:40:16 info: notify_crmd: Transition 2 status: te_complete - pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[7457]: 2007/09/19_19:40:16 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:16 WARN: process_pe_message: Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-193.bz2 pengine[7457]: 2007/09/19_19:40:16 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cib[8269]: 2007/09/19_19:40:16 info: write_cib_contents: Wrote version 0.89.1 of the CIB to disk (digest: 2491eef05b78b528a035f8e172eabed6) cibmon[7446]: 2007/09/19_19:40:24 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - tengine[7456]: 2007/09/19_19:40:24 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:40:24 info: log_cib_diff: cib_delete: Local-only Change: 0.90.1 cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - crmd[7452]: 2007/09/19_19:40:24 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - crmd[7452]: 2007/09/19_19:40:24 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:24 info: log_data_element: cib:diff: + cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:40:24 info: log_data_element: cib_delete: + pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' cib[8301]: 2007/09/19_19:40:24 info: write_cib_contents: Wrote version 0.90.1 of the CIB to disk (digest: 402caac3c0c1fcf70c9d775e1ee6d0ad) pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:40:24 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:40:24 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:40:24 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:40:24 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:24 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:40:24 info: unpack_graph: Unpacked transition 3: 0 actions in 0 synapses pengine[7457]: 2007/09/19_19:40:24 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:40:24 info: run_graph: Transition 3: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7457]: 2007/09/19_19:40:24 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:40:24 info: notify_crmd: Transition 3 status: te_complete - pengine[7457]: 2007/09/19_19:40:24 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:24 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:24 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:24 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:24 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:40:24 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:24 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:40:24 WARN: native_assign_node: 2 nodes with equal score (+INFINITY) for running the listed resources (chose host-1.awale.qc.ca): pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[7452]: 2007/09/19_19:40:24 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[7457]: 2007/09/19_19:40:24 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:24 WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-194.bz2 pengine[7457]: 2007/09/19_19:40:24 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[7446]: 2007/09/19_19:40:26 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed tengine[7456]: 2007/09/19_19:40:26 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:40:26 info: log_cib_diff: cib_delete: Local-only Change: 0.91.1 crmd[7452]: 2007/09/19_19:40:26 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - crmd[7452]: 2007/09/19_19:40:26 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:26 info: log_data_element: cib_delete: + cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: - cib[7448]: 2007/09/19_19:40:26 info: log_data_element: cib:diff: + pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' crmd[7452]: 2007/09/19_19:40:26 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' tengine[7456]: 2007/09/19_19:40:26 info: unpack_graph: Unpacked transition 4: 0 actions in 0 synapses pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' tengine[7456]: 2007/09/19_19:40:26 info: run_graph: Transition 4: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' tengine[7456]: 2007/09/19_19:40:26 info: notify_crmd: Transition 4 status: te_complete - pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:40:26 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:40:26 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:40:26 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:40:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:26 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:40:26 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:26 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) cib[8303]: 2007/09/19_19:40:26 info: write_cib_contents: Wrote version 0.91.1 of the CIB to disk (digest: 0266b5901a36c9838ee4a26107441caf) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[7457]: 2007/09/19_19:40:26 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:26 WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-195.bz2 pengine[7457]: 2007/09/19_19:40:26 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[7446]: 2007/09/19_19:40:31 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - tengine[7456]: 2007/09/19_19:40:31 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:40:31 info: log_cib_diff: cib_delete: Local-only Change: 0.92.1 cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - crmd[7452]: 2007/09/19_19:40:31 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - crmd[7452]: 2007/09/19_19:40:31 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cib[7448]: 2007/09/19_19:40:31 info: log_data_element: cib:diff: + cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:40:31 info: log_data_element: cib_delete: + cib[8383]: 2007/09/19_19:40:31 info: write_cib_contents: Wrote version 0.92.1 of the CIB to disk (digest: 57ed058141157cf1e3a34e9dbf76286e) pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' crmd[7452]: 2007/09/19_19:40:31 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:40:31 info: unpack_graph: Unpacked transition 5: 0 actions in 0 synapses pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[7456]: 2007/09/19_19:40:31 info: run_graph: Transition 5: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' tengine[7456]: 2007/09/19_19:40:31 info: notify_crmd: Transition 5 status: te_complete - pengine[7457]: 2007/09/19_19:40:31 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:40:31 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:40:31 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:40:31 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:40:31 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource share-drbd (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource share-drbdlinks (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource share-FS (host-1.awale.qc.ca) crmd[7452]: 2007/09/19_19:40:31 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource mysql (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource msg_first (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource msg_last (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource IPaddr_10_0_0_59 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 WARN: native_color: Resource child_DoFencing:1 cannot run anywhere pengine[7457]: 2007/09/19_19:40:31 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:40:31 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-196.bz2 pengine[7457]: 2007/09/19_19:40:31 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. stonithd[8497]: 2007/09/19_19:41:00 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8497]: 2007/09/19_19:41:00 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8641]: 2007/09/19_19:41:50 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8641]: 2007/09/19_19:41:50 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8870]: 2007/09/19_19:42:40 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8870]: 2007/09/19_19:42:40 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[8998]: 2007/09/19_19:43:30 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[8998]: 2007/09/19_19:43:30 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[9145]: 2007/09/19_19:44:20 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9145]: 2007/09/19_19:44:20 info: 10.0.0.166 has sysName 'RackPDU Archivage' heartbeat[7433]: 2007/09/19_19:44:57 info: Link host-2.awale.qc.ca:eth0 up. crmd[7452]: 2007/09/19_19:44:57 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [init] heartbeat[7433]: 2007/09/19_19:44:57 info: Status update for node host-2.awale.qc.ca: status init crmd[7452]: 2007/09/19_19:44:57 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [up] heartbeat[7433]: 2007/09/19_19:44:57 info: Status update for node host-2.awale.qc.ca: status up heartbeat[7433]: 2007/09/19_19:44:57 info: all clients are now paused heartbeat[7433]: 2007/09/19_19:44:58 info: all clients are now resumed heartbeat[7433]: 2007/09/19_19:44:58 info: Status update for node host-2.awale.qc.ca: status active crmd[7452]: 2007/09/19_19:44:58 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [active] cibmon[7446]: 2007/09/19_19:44:58 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:44:58 info: log_cib_diff: cib_update: Local-only Change: 0.92.1 cibmon[7446]: 2007/09/19_19:44:58 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:44:58 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:44:58 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:44:58 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:44:58 info: log_data_element: cib_update: + cib[7448]: 2007/09/19_19:44:58 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] heartbeat[7433]: 2007/09/19_19:45:00 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [11:13] heartbeat[7433]: 2007/09/19_19:45:00 info: No pkts missing from host-2.awale.qc.ca! crmd[7452]: 2007/09/19_19:45:00 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] heartbeat[7433]: 2007/09/19_19:45:01 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [16:18] heartbeat[7433]: 2007/09/19_19:45:01 info: No pkts missing from host-2.awale.qc.ca! cibmon[7446]: 2007/09/19_19:45:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:01 info: log_cib_diff: cib_update: Local-only Change: 0.92.1 cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:01 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[7452]: 2007/09/19_19:45:01 info: mem_handle_event: no mbr_track info crmd[7452]: 2007/09/19_19:45:01 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[7452]: 2007/09/19_19:45:01 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 cib[7448]: 2007/09/19_19:45:01 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[7452]: 2007/09/19_19:45:01 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) cib[7448]: 2007/09/19_19:45:01 info: mem_handle_event: no mbr_track info crmd[7452]: 2007/09/19_19:45:01 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=1, lost=0 n_idx=0, new_idx=2, old_idx=4 cib[7448]: 2007/09/19_19:45:01 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[7452]: 2007/09/19_19:45:01 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=1] cib[7448]: 2007/09/19_19:45:01 info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4 crmd[7452]: 2007/09/19_19:45:01 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=2] cib[7448]: 2007/09/19_19:45:01 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:45:01 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=2] cib[7448]: 2007/09/19_19:45:01 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:01 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:01 info: log_cib_diff: cib_update: Local-only Change: 0.92.1 cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:01 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:03 info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ] crmd[7452]: 2007/09/19_19:45:03 info: update_dc: Set DC to () tengine[7456]: 2007/09/19_19:45:03 info: update_abort_priority: Abort priority upgraded to 1000000 crmd[7452]: 2007/09/19_19:45:03 info: join_make_offer: Making join offers based on membership 2 crmd[7452]: 2007/09/19_19:45:03 info: do_dc_join_offer_all: join-2: Waiting on 2 outstanding join acks crmd[7452]: 2007/09/19_19:45:04 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7452]: 2007/09/19_19:45:04 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[7452]: 2007/09/19_19:45:04 info: do_state_transition: All 2 cluster nodes responded to the join offer. cib[7448]: 2007/09/19_19:45:04 info: sync_our_cib: Syncing CIB to all peers attrd[7451]: 2007/09/19_19:45:04 info: attrd_local_callback: Sending full refresh cibmon[7446]: 2007/09/19_19:45:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: --- 0.92.1 cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: +++ 0.92.2 cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: --- 0.92.2 cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: +++ 0.92.3 cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:04 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: --- 0.92.3 cibmon[7446]: 2007/09/19_19:45:04 info: log_cib_diff: cib_update: Diff: +++ 0.92.4 cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:04 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:05 info: update_dc: Set DC to host-1.awale.qc.ca (1.0.9) crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;23:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;17:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;19:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (vmstat-mon_start_0) was 565d0e995d90a81dff17a2872da52bd8 crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;19:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;29:0:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (child_DoFencing:0_start_0) was a48b2b8308a00f9fb8a169e964b6419c crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;3:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;7:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;12:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: build_operation_update: Digest for 0:0;5:1:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-drbdlinks_start_0) was a496b0578fd50c1c9463504fe9edd75b crmd[7452]: 2007/09/19_19:45:05 info: log_data_element: build_operation_update: digest:source crmd[7452]: 2007/09/19_19:45:05 info: do_dc_join_ack: join-2: Updating node state to member for host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action msg_first_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: --- 0.92.4 tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action msg_last_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: +++ 0.92.5 tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action vmstat-mon_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action IPaddr_10_0_0_59_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action child_DoFencing:0_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action share-drbd_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action child_DoFencing:1_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action share-FS_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action mysql_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:05 info: process_graph_event: Detected action share-drbdlinks_monitor_0 from a different transition: 0 vs. 5 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:05 info: do_dc_join_ack: join-2: Updating node state to member for host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: --- 0.92.5 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: +++ 0.92.6 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:45:05 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:05 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:45:05 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:45:05 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:45:05 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[7457]: 2007/09/19_19:45:05 info: native_print: share-drbd (heartbeat:drbddisk): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: mysql (heartbeat::ocf:mysql): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: msg_first (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: msg_last (heartbeat:msg): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:45:05 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:05 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Stopped pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource share-drbd (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start share-drbd pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource share-drbdlinks (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop share-drbdlinks pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource share-FS (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop share-FS pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start share-FS pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource mysql (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop mysql pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource msg_first (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_first pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start msg_first pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource msg_last (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop msg_last pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StopRsc: host-1.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:45:05 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:05 notice: StartRsc: host-2.awale.qc.ca Start child_DoFencing:1 pengine[7457]: 2007/09/19_19:45:05 notice: RecurringOp: host-2.awale.qc.ca child_DoFencing:1_monitor_50000 crmd[7452]: 2007/09/19_19:45:05 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:45:05 info: process_pe_message: Transition 6: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-307.bz2 tengine[7456]: 2007/09/19_19:45:05 info: unpack_graph: Unpacked transition 6: 37 actions in 37 synapses tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 12: share-drbd_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 13: share-drbdlinks_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 26: share-drbdlinks_stop_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 14: share-FS_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 15: vmstat-mon_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 16: mysql_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 17: msg_first_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 18: msg_last_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 40: msg_last_stop_0 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:45:05 info: do_lrm_rsc_op: Performing op=share-drbdlinks_stop_0 key=26:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 19: IPaddr_10_0_0_59_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 20: child_DoFencing:0_monitor_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 21: child_DoFencing:1_monitor_0 on host-2.awale.qc.ca crmd[7452]: 2007/09/19_19:45:05 info: do_lrm_rsc_op: Performing op=msg_last_stop_0 key=40:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:45:05 info: process_lrm_event: LRM operation share-drbdlinks_monitor_120000 (call=25, rc=-2) Cancelled crmd[7452]: 2007/09/19_19:45:05 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=29, rc=-2) Cancelled cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: --- 0.92.6 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: +++ 0.92.7 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: --- 0.92.7 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: +++ 0.92.8 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: + crmd[7452]: 2007/09/19_19:45:05 info: process_lrm_event: LRM operation share-drbdlinks_stop_0 (call=30, rc=0) complete cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:05 info: match_graph_event: Action share-drbdlinks_stop_0 (26) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: --- 0.92.8 tengine[7456]: 2007/09/19_19:45:05 info: send_rsc_command: Initiating action 29: share-FS_stop_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_update: Diff: +++ 0.92.9 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:05 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=29:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:45:05 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=24, rc=-2) Cancelled cibmon[7446]: 2007/09/19_19:45:05 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: --- 0.92.9 cibmon[7446]: 2007/09/19_19:45:05 info: log_cib_diff: cib_delete: Diff: +++ 0.92.10 cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:05 info: log_data_element: cib_delete: + msg[9376][9406]: 2007/09/19_19:45:06 INFO Starting to switch away from this node. msg[9376][9410]: 2007/09/19_19:45:06 INFO Node: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation msg_last_stop_0 (call=31, rc=0) complete cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: --- 0.92.10 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: +++ 0.92.11 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:06 info: match_graph_event: Action msg_last_stop_0 (40) confirmed on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:45:06 info: send_rsc_command: Initiating action 34: mysql_stop_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:45:06 info: send_rsc_command: Initiating action 43: IPaddr_10_0_0_59_stop_0 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:45:06 info: do_lrm_rsc_op: Performing op=mysql_stop_0 key=34:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:45:06 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_stop_0 key=43:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) Filesystem[9390][9443]: 2007/09/19_19:45:06 INFO: Running stop for /dev/drbd0 on /share crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=27, rc=-2) Cancelled crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=26, rc=-2) Cancelled cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: --- 0.92.11 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: +++ 0.92.12 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: --- 0.92.12 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: +++ 0.92.13 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: + Filesystem[9390][9466]: 2007/09/19_19:45:06 INFO: Trying to unmount /share Filesystem[9390][9471]: 2007/09/19_19:45:06 INFO: unmounted /share successfully crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation share-FS_stop_0 (call=32, rc=0) complete lrmd[7449]: 2007/09/19_19:45:06 info: RA output: (IPaddr_10_0_0_59:stop:stdout) In IP Stop cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: --- 0.92.13 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: +++ 0.92.14 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + lrmd[7449]: 2007/09/19_19:45:06 info: RA output: (IPaddr_10_0_0_59:stop:stderr) SIOCDELRT: No such process tengine[7456]: 2007/09/19_19:45:06 info: match_graph_event: Action share-FS_stop_0 (29) confirmed on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:45:06 info: send_rsc_command: Initiating action 23: share-drbd_stop_0 on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:45:06 info: do_lrm_rsc_op: Performing op=share-drbd_stop_0 key=23:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=21, rc=-2) Cancelled IPaddr[9445][9486]: 2007/09/19_19:45:06 INFO: ifconfig eth0:0 down cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: --- 0.92.14 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_delete: Diff: +++ 0.92.15 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_delete: + crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_stop_0 (call=34, rc=0) complete cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: --- 0.92.15 cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: +++ 0.92.16 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:06 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (43) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:06 info: process_lrm_event: LRM operation share-drbd_stop_0 (call=35, rc=0) complete cibmon[7446]: 2007/09/19_19:45:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: --- 0.92.16 tengine[7456]: 2007/09/19_19:45:06 info: match_graph_event: Action share-drbd_stop_0 (23) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:06 info: log_cib_diff: cib_update: Diff: +++ 0.92.17 cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: --- 0.92.17 cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: +++ 0.92.18 cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:07 info: match_graph_event: Action share-drbd_monitor_0 (12) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:07 info: match_graph_event: Action share-drbdlinks_monitor_0 (13) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: --- 0.92.18 cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: +++ 0.92.19 cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: --- 0.92.19 cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: +++ 0.92.20 tengine[7456]: 2007/09/19_19:45:07 info: match_graph_event: Action vmstat-mon_monitor_0 (15) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: --- 0.92.20 cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: +++ 0.92.21 cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:07 info: match_graph_event: Action mysql_monitor_0 (16) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: --- 0.92.21 cibmon[7446]: 2007/09/19_19:45:07 info: log_cib_diff: cib_update: Diff: +++ 0.92.22 cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:07 info: match_graph_event: Action share-FS_monitor_0 (14) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: --- 0.92.22 cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: +++ 0.92.23 cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:08 info: match_graph_event: Action child_DoFencing:0_monitor_0 (20) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: --- 0.92.23 tengine[7456]: 2007/09/19_19:45:08 info: match_graph_event: Action msg_last_monitor_0 (18) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: +++ 0.92.24 cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:08 info: match_graph_event: Action msg_first_monitor_0 (17) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: --- 0.92.24 cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: +++ 0.92.25 cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:08 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_0 (19) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: --- 0.92.25 cibmon[7446]: 2007/09/19_19:45:08 info: log_cib_diff: cib_update: Diff: +++ 0.92.26 cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:08 info: log_data_element: cib_update: + mysql[9436][9500]: 2007/09/19_19:45:09 INFO: MySQL stopped crmd[7452]: 2007/09/19_19:45:09 info: process_lrm_event: LRM operation mysql_stop_0 (call=33, rc=0) complete cibmon[7446]: 2007/09/19_19:45:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: --- 0.92.26 cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: +++ 0.92.27 cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:09 info: match_graph_event: Action mysql_stop_0 (34) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: send_rsc_command: Initiating action 37: msg_first_stop_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:09 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=37:6:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:45:09 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=18, rc=-2) Cancelled cibmon[7446]: 2007/09/19_19:45:09 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_delete: Diff: --- 0.92.27 cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_delete: Diff: +++ 0.92.28 cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_delete: + msg[9503][9524]: 2007/09/19_19:45:09 INFO Completed switching away from this node. msg[9503][9525]: 2007/09/19_19:45:09 INFO Node: host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: --- 0.92.28 cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: +++ 0.92.29 cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:45:09 info: process_lrm_event: LRM operation msg_first_stop_0 (call=36, rc=0) complete cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: match_graph_event: Action child_DoFencing:1_monitor_0 (21) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: send_rsc_command: Initiating action 11: probe_complete on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: te_pseudo_action: Pseudo action 10 fired and confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: te_pseudo_action: Pseudo action 50 fired and confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: send_rsc_command: Initiating action 48: child_DoFencing:1_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: --- 0.92.29 cibmon[7446]: 2007/09/19_19:45:09 info: log_cib_diff: cib_update: Diff: +++ 0.92.30 cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:09 info: match_graph_event: Action msg_first_stop_0 (37) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:09 info: send_rsc_command: Initiating action 38: msg_first_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[7446]: 2007/09/19_19:45:10 info: log_cib_diff: cib_modify: Diff: --- 0.92.30 cibmon[7446]: 2007/09/19_19:45:10 info: log_cib_diff: cib_modify: Diff: +++ 0.92.31 cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: - tengine[7456]: 2007/09/19_19:45:10 info: extract_event: Aborting on transient_attributes changes for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + tengine[7456]: 2007/09/19_19:45:10 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + tengine[7456]: 2007/09/19_19:45:10 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_modify: + cibmon[7446]: 2007/09/19_19:45:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:10 info: match_graph_event: Action child_DoFencing:1_start_0 (48) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:10 info: log_cib_diff: cib_update: Diff: --- 0.92.31 cibmon[7446]: 2007/09/19_19:45:10 info: log_cib_diff: cib_update: Diff: +++ 0.92.32 tengine[7456]: 2007/09/19_19:45:10 info: te_pseudo_action: Pseudo action 51 fired and confirmed cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:10 info: log_data_element: cib_update: + stonithd[9536]: 2007/09/19_19:45:10 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9536]: 2007/09/19_19:45:10 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[7446]: 2007/09/19_19:45:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:11 info: log_cib_diff: cib_update: Diff: --- 0.92.32 crmd[7452]: 2007/09/19_19:45:11 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:45:11 info: match_graph_event: Action msg_first_start_0 (38) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:11 info: log_cib_diff: cib_update: Diff: +++ 0.92.33 crmd[7452]: 2007/09/19_19:45:11 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[7456]: 2007/09/19_19:45:11 info: run_graph: ==================================================== cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:11 notice: run_graph: Transition 6: (Complete=23, Pending=0, Fired=0, Skipped=14, Incomplete=0) cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:11 info: log_data_element: cib_update: + pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:45:11 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:45:11 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:45:11 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[7457]: 2007/09/19_19:45:11 info: native_print: share-drbd (heartbeat:drbddisk): Stopped pengine[7457]: 2007/09/19_19:45:11 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[7457]: 2007/09/19_19:45:11 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped crmd[7452]: 2007/09/19_19:45:11 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:45:11 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[7457]: 2007/09/19_19:45:11 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 info: native_print: msg_last (heartbeat:msg): Stopped pengine[7457]: 2007/09/19_19:45:11 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[7457]: 2007/09/19_19:45:11 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:45:11 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start share-drbd tengine[7456]: 2007/09/19_19:45:11 info: unpack_graph: Unpacked transition 7: 14 actions in 14 synapses pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca share-drbd_monitor_120000 tengine[7456]: 2007/09/19_19:45:11 info: send_rsc_command: Initiating action 6: share-drbd_start_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start share-drbdlinks tengine[7456]: 2007/09/19_19:45:11 info: send_rsc_command: Initiating action 14: mysql_start_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca share-drbdlinks_monitor_120000 tengine[7456]: 2007/09/19_19:45:11 info: send_rsc_command: Initiating action 18: msg_first_monitor_120000 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start share-FS tengine[7456]: 2007/09/19_19:45:11 info: send_rsc_command: Initiating action 21: IPaddr_10_0_0_59_start_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca share-FS_monitor_120000 tengine[7456]: 2007/09/19_19:45:11 info: send_rsc_command: Initiating action 27: child_DoFencing:1_monitor_50000 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:45:11 notice: NoRoleChange: Leave resource vmstat-mon (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:45:11 notice: NoRoleChange: Leave resource msg_first (host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca msg_first_monitor_120000 pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start msg_last pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:45:11 notice: StartRsc: host-2.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:45:11 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:11 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:45:11 notice: RecurringOp: host-2.awale.qc.ca child_DoFencing:1_monitor_50000 pengine[7457]: 2007/09/19_19:45:11 info: process_pe_message: Transition 7: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-308.bz2 tengine[7456]: 2007/09/19_19:45:12 info: match_graph_event: Action share-drbd_start_0 (6) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:12 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:12 info: log_cib_diff: cib_update: Diff: --- 0.92.33 cibmon[7446]: 2007/09/19_19:45:12 info: log_cib_diff: cib_update: Diff: +++ 0.92.34 cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:12 info: send_rsc_command: Initiating action 7: share-drbd_monitor_120000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:12 info: send_rsc_command: Initiating action 10: share-FS_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:12 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:13 info: match_graph_event: Action msg_first_monitor_120000 (18) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:13 info: log_cib_diff: cib_update: Diff: --- 0.92.34 cibmon[7446]: 2007/09/19_19:45:13 info: log_cib_diff: cib_update: Diff: +++ 0.92.35 cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:14 info: match_graph_event: Action share-drbd_monitor_120000 (7) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: --- 0.92.35 cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: +++ 0.92.36 cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: --- 0.92.36 cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: +++ 0.92.37 cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:14 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (21) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:14 info: send_rsc_command: Initiating action 22: IPaddr_10_0_0_59_monitor_5000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: --- 0.92.37 cibmon[7446]: 2007/09/19_19:45:14 info: log_cib_diff: cib_update: Diff: +++ 0.92.38 cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:45:14 info: match_graph_event: Action child_DoFencing:1_monitor_50000 (27) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:16 info: match_graph_event: Action share-FS_start_0 (10) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:16 info: log_cib_diff: cib_update: Diff: --- 0.92.38 tengine[7456]: 2007/09/19_19:45:16 info: send_rsc_command: Initiating action 8: share-drbdlinks_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:16 info: log_cib_diff: cib_update: Diff: +++ 0.92.39 tengine[7456]: 2007/09/19_19:45:16 info: send_rsc_command: Initiating action 11: share-FS_monitor_120000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:16 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (22) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:16 info: log_cib_diff: cib_update: Diff: --- 0.92.39 cibmon[7446]: 2007/09/19_19:45:16 info: log_cib_diff: cib_update: Diff: +++ 0.92.40 cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:16 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:17 info: log_cib_diff: cib_update: Diff: --- 0.92.40 cibmon[7446]: 2007/09/19_19:45:17 info: log_cib_diff: cib_update: Diff: +++ 0.92.41 cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:17 info: match_graph_event: Action share-drbdlinks_start_0 (8) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:17 info: send_rsc_command: Initiating action 9: share-drbdlinks_monitor_120000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:17 info: match_graph_event: Action share-FS_monitor_120000 (11) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:17 info: log_cib_diff: cib_update: Diff: --- 0.92.41 cibmon[7446]: 2007/09/19_19:45:17 info: log_cib_diff: cib_update: Diff: +++ 0.92.42 cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:18 info: log_cib_diff: cib_update: Diff: --- 0.92.42 tengine[7456]: 2007/09/19_19:45:18 info: match_graph_event: Action share-drbdlinks_monitor_120000 (9) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:18 info: log_cib_diff: cib_update: Diff: +++ 0.92.43 cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:22 info: match_graph_event: Action mysql_start_0 (14) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:22 info: log_cib_diff: cib_update: Diff: --- 0.92.43 tengine[7456]: 2007/09/19_19:45:22 info: send_rsc_command: Initiating action 15: mysql_monitor_120000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:22 info: log_cib_diff: cib_update: Diff: +++ 0.92.44 tengine[7456]: 2007/09/19_19:45:22 info: send_rsc_command: Initiating action 19: msg_last_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:22 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:45:24 info: match_graph_event: Action mysql_monitor_120000 (15) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:45:24 info: log_cib_diff: cib_update: Diff: --- 0.92.44 cibmon[7446]: 2007/09/19_19:45:24 info: log_cib_diff: cib_update: Diff: +++ 0.92.45 cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:24 info: match_graph_event: Action msg_last_start_0 (19) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:24 info: log_cib_diff: cib_update: Diff: --- 0.92.45 tengine[7456]: 2007/09/19_19:45:24 info: send_rsc_command: Initiating action 20: msg_last_monitor_120000 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:24 info: log_cib_diff: cib_update: Diff: +++ 0.92.46 cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:24 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:45:26 info: match_graph_event: Action msg_last_monitor_120000 (20) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:45:26 info: log_cib_diff: cib_update: Diff: --- 0.92.46 crmd[7452]: 2007/09/19_19:45:26 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:45:26 info: run_graph: Transition 7: (Complete=14, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[7446]: 2007/09/19_19:45:26 info: log_cib_diff: cib_update: Diff: +++ 0.92.47 tengine[7456]: 2007/09/19_19:45:26 info: notify_crmd: Transition 7 status: te_complete - cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:45:26 info: log_data_element: cib_update: + stonithd[9541]: 2007/09/19_19:46:00 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[9541]: 2007/09/19_19:46:00 info: 10.0.0.166 has sysName 'RackPDU Archivage' cibmon[7446]: 2007/09/19_19:46:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_delete: Diff: --- 0.92.47 cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_delete: Diff: +++ 0.92.48 cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: - cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cib[7448]: 2007/09/19_19:46:06 info: log_data_element: cib:diff: + cibmon[7446]: 2007/09/19_19:46:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:06 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_update: Diff: --- 0.92.48 cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_update: Diff: +++ 0.93.1 cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:06 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[7452]: 2007/09/19_19:46:06 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cib[9543]: 2007/09/19_19:46:06 info: write_cib_contents: Wrote version 0.93.1 of the CIB to disk (digest: fb001af0b9881a7fdcd1fbfef5880feb) pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:46:06 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:46:06 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:46:06 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[7457]: 2007/09/19_19:46:06 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: msg_last (heartbeat:msg): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:46:06 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource share-drbd (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource share-drbdlinks (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop share-drbdlinks pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca share-drbdlinks_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource share-FS (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop share-FS pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource vmstat-mon (host-1.awale.qc.ca -> host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-1.awale.qc.ca Stop vmstat-mon pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-2.awale.qc.ca Start vmstat-mon pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource msg_first (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop msg_first pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start msg_first pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource msg_last (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop msg_last pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start msg_last pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: StopRsc: host-2.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:46:06 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:46:06 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:06 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) crmd[7452]: 2007/09/19_19:46:06 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:46:06 info: process_pe_message: Transition 8: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-309.bz2 tengine[7456]: 2007/09/19_19:46:06 info: unpack_graph: Unpacked transition 8: 24 actions in 24 synapses tengine[7456]: 2007/09/19_19:46:06 info: send_rsc_command: Initiating action 17: share-drbdlinks_stop_0 on host-2.awale.qc.ca tengine[7456]: 2007/09/19_19:46:06 info: send_rsc_command: Initiating action 23: vmstat-mon_stop_0 on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:46:06 info: send_rsc_command: Initiating action 32: msg_last_stop_0 on host-2.awale.qc.ca crmd[7452]: 2007/09/19_19:46:06 info: do_lrm_rsc_op: Performing op=vmstat-mon_stop_0 key=23:8:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:06 info: process_lrm_event: LRM operation vmstat-mon_monitor_120000 (call=16, rc=-2) Cancelled cibmon[7446]: 2007/09/19_19:46:06 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_delete: Diff: --- 0.93.1 cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_delete: Diff: +++ 0.93.2 cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_delete: + daemontools[9545][9554]: 2007/09/19_19:46:06 INFO Stoping vmstat-mon crmd[7452]: 2007/09/19_19:46:06 info: process_lrm_event: LRM operation vmstat-mon_stop_0 (call=37, rc=0) complete cibmon[7446]: 2007/09/19_19:46:06 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_update: Diff: --- 0.93.2 cibmon[7446]: 2007/09/19_19:46:06 info: log_cib_diff: cib_update: Diff: +++ 0.93.3 tengine[7456]: 2007/09/19_19:46:06 info: match_graph_event: Action vmstat-mon_stop_0 (23) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:06 info: send_rsc_command: Initiating action 24: vmstat-mon_start_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:06 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_delete: Diff: --- 0.93.3 cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_delete: Diff: +++ 0.93.4 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:07 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_delete: Diff: --- 0.93.4 cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_delete: Diff: +++ 0.93.5 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: --- 0.93.5 cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: +++ 0.93.6 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:07 WARN: status_from_rc: Action stop on host-2.awale.qc.ca failed (target: vs. rc: 1): Error cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:07 info: update_abort_priority: Abort priority upgraded to 1 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:07 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:07 info: match_graph_event: Action share-drbdlinks_stop_0 (17) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:07 info: match_graph_event: Action msg_last_stop_0 (32) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: --- 0.93.6 cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: +++ 0.93.7 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: --- 0.93.7 cibmon[7446]: 2007/09/19_19:46:07 info: log_cib_diff: cib_update: Diff: +++ 0.93.8 cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:07 info: match_graph_event: Action vmstat-mon_start_0 (24) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:07 info: run_graph: ==================================================== cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:07 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:46:07 notice: run_graph: Transition 8: (Complete=4, Pending=0, Fired=0, Skipped=20, Incomplete=0) cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:07 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:07 info: log_data_element: cib_update: + pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[7457]: 2007/09/19_19:46:07 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[7457]: 2007/09/19_19:46:07 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[7457]: 2007/09/19_19:46:07 info: determine_online_status: Node host-2.awale.qc.ca is online pengine[7457]: 2007/09/19_19:46:07 WARN: unpack_rsc_op: Processing failed op (share-drbdlinks_stop_0) on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 WARN: unpack_rsc_op: Handling failed stop for share-drbdlinks on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: share-drbd (heartbeat:drbddisk): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Started host-2.awale.qc.ca (unmanaged) FAILED pengine[7457]: 2007/09/19_19:46:07 info: native_print: share-FS (heartbeat::ocf:Filesystem): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: vmstat-mon (heartbeat:daemontools): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: mysql (heartbeat::ocf:mysql): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: msg_first (heartbeat:msg): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: msg_last (heartbeat:msg): Stopped pengine[7457]: 2007/09/19_19:46:07 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: clone_print: Clone Set: DoFencing pengine[7457]: 2007/09/19_19:46:07 info: native_print: child_DoFencing:0 (stonith:apcsnmp): Started host-1.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 info: native_print: child_DoFencing:1 (stonith:apcsnmp): Started host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Move resource share-drbd (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start share-drbd pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca share-drbd_monitor_120000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Recover resource share-drbdlinks (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 WARN: custom_action: Action share-drbdlinks_stop_0 (unmanaged) pengine[7457]: 2007/09/19_19:46:07 WARN: custom_action: Action share-drbdlinks_start_0 (unmanaged) crmd[7452]: 2007/09/19_19:46:07 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start share-drbdlinks pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Move resource share-FS (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: StopRsc: host-2.awale.qc.ca Stop share-FS pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start share-FS pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca share-FS_monitor_120000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Leave resource vmstat-mon (host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-2.awale.qc.ca vmstat-mon_monitor_120000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Move resource mysql (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: StopRsc: host-2.awale.qc.ca Stop mysql pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start mysql pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca mysql_monitor_120000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Move resource msg_first (host-2.awale.qc.ca -> host-1.awale.qc.ca) tengine[7456]: 2007/09/19_19:46:07 info: unpack_graph: Unpacked transition 9: 18 actions in 18 synapses pengine[7457]: 2007/09/19_19:46:07 notice: StopRsc: host-2.awale.qc.ca Stop msg_first tengine[7456]: 2007/09/19_19:46:07 info: send_rsc_command: Initiating action 16: share-FS_stop_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start msg_first tengine[7456]: 2007/09/19_19:46:07 info: send_rsc_command: Initiating action 21: vmstat-mon_monitor_120000 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca msg_first_monitor_120000 tengine[7456]: 2007/09/19_19:46:07 info: send_rsc_command: Initiating action 22: mysql_stop_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start msg_last tengine[7456]: 2007/09/19_19:46:07 info: send_rsc_command: Initiating action 30: IPaddr_10_0_0_59_stop_0 on host-2.awale.qc.ca pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca msg_last_monitor_120000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Move resource IPaddr_10_0_0_59 (host-2.awale.qc.ca -> host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: StopRsc: host-2.awale.qc.ca Stop IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:46:07 notice: StartRsc: host-1.awale.qc.ca Start IPaddr_10_0_0_59 pengine[7457]: 2007/09/19_19:46:07 notice: RecurringOp: host-1.awale.qc.ca IPaddr_10_0_0_59_monitor_5000 pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Leave resource child_DoFencing:0 (host-1.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 notice: NoRoleChange: Leave resource child_DoFencing:1 (host-2.awale.qc.ca) pengine[7457]: 2007/09/19_19:46:07 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[7457]: 2007/09/19_19:46:07 WARN: should_dump_action: action 15 (share-drbdlinks_start_0) was for an unmanaged resource (share-drbdlinks) pengine[7457]: 2007/09/19_19:46:07 WARN: process_pe_message: Transition 9: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-197.bz2 pengine[7457]: 2007/09/19_19:46:07 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. cibmon[7446]: 2007/09/19_19:46:08 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: --- 0.93.8 cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: +++ 0.93.9 cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:08 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: --- 0.93.9 cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: +++ 0.93.10 cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:08 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: --- 0.93.10 cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_delete: Diff: +++ 0.93.11 cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:08 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_update: Diff: --- 0.93.11 cibmon[7446]: 2007/09/19_19:46:08 info: log_cib_diff: cib_update: Diff: +++ 0.93.12 cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:08 info: match_graph_event: Action vmstat-mon_monitor_120000 (21) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:08 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:09 info: log_cib_diff: cib_update: Diff: --- 0.93.12 cibmon[7446]: 2007/09/19_19:46:09 info: log_cib_diff: cib_update: Diff: +++ 0.93.13 cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:09 info: match_graph_event: Action IPaddr_10_0_0_59_stop_0 (30) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:09 info: match_graph_event: Action share-FS_stop_0 (16) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:09 info: log_cib_diff: cib_update: Diff: --- 0.93.13 tengine[7456]: 2007/09/19_19:46:09 info: send_rsc_command: Initiating action 11: share-drbd_stop_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:09 info: log_cib_diff: cib_update: Diff: +++ 0.93.14 cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:09 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:10 info: log_cib_diff: cib_delete: Diff: --- 0.93.14 cibmon[7446]: 2007/09/19_19:46:10 info: log_cib_diff: cib_delete: Diff: +++ 0.93.15 cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:10 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:10 info: log_cib_diff: cib_update: Diff: --- 0.93.15 cibmon[7446]: 2007/09/19_19:46:10 info: log_cib_diff: cib_update: Diff: +++ 0.93.16 tengine[7456]: 2007/09/19_19:46:10 info: match_graph_event: Action share-drbd_stop_0 (11) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:10 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:11 info: match_graph_event: Action mysql_stop_0 (22) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:11 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:11 info: send_rsc_command: Initiating action 25: msg_first_stop_0 on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:11 info: log_cib_diff: cib_update: Diff: --- 0.93.16 cibmon[7446]: 2007/09/19_19:46:11 info: log_cib_diff: cib_update: Diff: +++ 0.93.17 cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:11 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:12 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[7446]: 2007/09/19_19:46:12 info: log_cib_diff: cib_delete: Diff: --- 0.93.17 cibmon[7446]: 2007/09/19_19:46:12 info: log_cib_diff: cib_delete: Diff: +++ 0.93.18 cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: - cibmon[7446]: 2007/09/19_19:46:12 info: log_data_element: cib_delete: + cibmon[7446]: 2007/09/19_19:46:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:13 info: match_graph_event: Action msg_first_stop_0 (25) confirmed on host-2.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: --- 0.93.18 tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 26: msg_first_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: +++ 0.93.19 crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=26:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + msg[9561][9582]: 2007/09/19_19:46:13 INFO Starting to switch to this node. msg[9561][9583]: 2007/09/19_19:46:13 INFO Node: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:46:13 info: process_lrm_event: LRM operation msg_first_start_0 (call=38, rc=0) complete crmd[7452]: 2007/09/19_19:46:13 info: build_operation_update: Digest for 0:0;26:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[7452]: 2007/09/19_19:46:13 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:13 info: match_graph_event: Action msg_first_start_0 (26) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: --- 0.93.19 cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: +++ 0.93.20 cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 12: share-drbd_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 23: mysql_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 27: msg_first_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 31: IPaddr_10_0_0_59_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=share-drbd_start_0 key=12:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=mysql_start_0 key=23:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=27:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_start_0 key=31:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:13 info: process_lrm_event: LRM operation share-drbd_start_0 (call=39, rc=0) complete crmd[7452]: 2007/09/19_19:46:13 info: build_operation_update: Digest for 0:0;12:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-drbd_start_0) was eaef18223bea84e8b011465368d9f74e crmd[7452]: 2007/09/19_19:46:13 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: --- 0.93.20 cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: +++ 0.93.21 cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: match_graph_event: Action share-drbd_start_0 (12) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 13: share-drbd_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:13 info: send_rsc_command: Initiating action 17: share-FS_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=share-drbd_monitor_120000 key=13:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:13 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=17:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) crmd[7452]: 2007/09/19_19:46:13 info: process_lrm_event: LRM operation share-drbd_monitor_120000 (call=43, rc=0) complete cibmon[7446]: 2007/09/19_19:46:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: --- 0.93.21 cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: +++ 0.93.22 cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:13 info: match_graph_event: Action share-drbd_monitor_120000 (13) confirmed on host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:46:13 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=41, rc=0) complete cibmon[7446]: 2007/09/19_19:46:13 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: --- 0.93.22 cibmon[7446]: 2007/09/19_19:46:13 info: log_cib_diff: cib_update: Diff: +++ 0.93.23 cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:13 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:13 info: match_graph_event: Action msg_first_monitor_120000 (27) confirmed on host-1.awale.qc.ca IPaddr[9601][9679]: 2007/09/19_19:46:13 INFO: Using calculated nic for 10.0.0.59: eth0 IPaddr[9601][9687]: 2007/09/19_19:46:13 INFO: Using calculated netmask for 10.0.0.59: 255.255.255.0 IPaddr[9601][9728]: 2007/09/19_19:46:13 INFO: eval ifconfig eth0:0 10.0.0.59 netmask 255.255.255.0 broadcast 10.0.0.255 crmd[7452]: 2007/09/19_19:46:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_start_0 (call=42, rc=0) complete crmd[7452]: 2007/09/19_19:46:14 info: build_operation_update: Digest for 0:0;31:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (IPaddr_10_0_0_59_start_0) was faa1a044ea4af72e835e7204ea88f0c5 crmd[7452]: 2007/09/19_19:46:14 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: --- 0.93.23 cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: +++ 0.93.24 cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:14 info: match_graph_event: Action IPaddr_10_0_0_59_start_0 (31) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:14 info: send_rsc_command: Initiating action 32: IPaddr_10_0_0_59_monitor_5000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:46:14 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_5000 key=32:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:14 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_5000 (call=45, rc=0) complete cibmon[7446]: 2007/09/19_19:46:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:14 info: match_graph_event: Action IPaddr_10_0_0_59_monitor_5000 (32) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: --- 0.93.24 cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: +++ 0.93.25 cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + Filesystem[9770][9799]: 2007/09/19_19:46:14 INFO: Running start for /dev/drbd0 on /share crmd[7452]: 2007/09/19_19:46:14 info: process_lrm_event: LRM operation share-FS_start_0 (call=44, rc=0) complete crmd[7452]: 2007/09/19_19:46:14 info: build_operation_update: Digest for 0:0;17:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[7452]: 2007/09/19_19:46:14 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:14 info: match_graph_event: Action share-FS_start_0 (17) confirmed on host-1.awale.qc.ca tengine[7456]: 2007/09/19_19:46:14 info: send_rsc_command: Initiating action 18: share-FS_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: --- 0.93.25 cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: +++ 0.93.26 crmd[7452]: 2007/09/19_19:46:14 info: do_lrm_rsc_op: Performing op=share-FS_monitor_120000 key=18:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:14 info: process_lrm_event: LRM operation share-FS_monitor_120000 (call=46, rc=0) complete cibmon[7446]: 2007/09/19_19:46:14 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:14 info: match_graph_event: Action share-FS_monitor_120000 (18) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: --- 0.93.26 cibmon[7446]: 2007/09/19_19:46:14 info: log_cib_diff: cib_update: Diff: +++ 0.93.27 cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:14 info: log_data_element: cib_update: + mysql[9594][9849]: 2007/09/19_19:46:17 INFO: MySQL started crmd[7452]: 2007/09/19_19:46:17 info: process_lrm_event: LRM operation mysql_start_0 (call=40, rc=0) complete crmd[7452]: 2007/09/19_19:46:17 info: build_operation_update: Digest for 0:0;23:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (mysql_start_0) was 5bbe7369a31cea709ce228b7a631f6fb crmd[7452]: 2007/09/19_19:46:17 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: --- 0.93.27 cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: +++ 0.93.28 cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:17 info: match_graph_event: Action mysql_start_0 (23) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:17 info: send_rsc_command: Initiating action 24: mysql_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:17 info: send_rsc_command: Initiating action 28: msg_last_start_0 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:46:17 info: do_lrm_rsc_op: Performing op=mysql_monitor_120000 key=24:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:17 info: do_lrm_rsc_op: Performing op=msg_last_start_0 key=28:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:17 info: process_lrm_event: LRM operation mysql_monitor_120000 (call=47, rc=0) complete cibmon[7446]: 2007/09/19_19:46:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: --- 0.93.28 cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: +++ 0.93.29 cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + tengine[7456]: 2007/09/19_19:46:17 info: match_graph_event: Action mysql_monitor_120000 (24) confirmed on host-1.awale.qc.ca msg[9851][9879]: 2007/09/19_19:46:17 INFO Completed switching to this node. msg[9851][9880]: 2007/09/19_19:46:17 INFO Node: host-1.awale.qc.ca crmd[7452]: 2007/09/19_19:46:17 info: process_lrm_event: LRM operation msg_last_start_0 (call=48, rc=0) complete crmd[7452]: 2007/09/19_19:46:17 info: build_operation_update: Digest for 0:0;28:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2 (msg_last_start_0) was 7baea18f0cc3c8eaf87549bad3dc9ca5 crmd[7452]: 2007/09/19_19:46:17 info: log_data_element: build_operation_update: digest:source cibmon[7446]: 2007/09/19_19:46:17 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: --- 0.93.29 cibmon[7446]: 2007/09/19_19:46:17 info: log_cib_diff: cib_update: Diff: +++ 0.93.30 tengine[7456]: 2007/09/19_19:46:17 info: match_graph_event: Action msg_last_start_0 (28) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - tengine[7456]: 2007/09/19_19:46:17 info: send_rsc_command: Initiating action 29: msg_last_monitor_120000 on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - crmd[7452]: 2007/09/19_19:46:17 info: do_lrm_rsc_op: Performing op=msg_last_monitor_120000 key=29:9:b477bd1c-6f1c-4b6d-be11-b5eaec7904c2) cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:17 info: log_data_element: cib_update: + crmd[7452]: 2007/09/19_19:46:18 info: process_lrm_event: LRM operation msg_last_monitor_120000 (call=49, rc=0) complete cibmon[7446]: 2007/09/19_19:46:18 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[7456]: 2007/09/19_19:46:18 info: match_graph_event: Action msg_last_monitor_120000 (29) confirmed on host-1.awale.qc.ca cibmon[7446]: 2007/09/19_19:46:18 info: log_cib_diff: cib_update: Diff: --- 0.93.30 crmd[7452]: 2007/09/19_19:46:18 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[7456]: 2007/09/19_19:46:18 info: run_graph: Transition 9: (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[7446]: 2007/09/19_19:46:18 info: log_cib_diff: cib_update: Diff: +++ 0.93.31 tengine[7456]: 2007/09/19_19:46:18 info: notify_crmd: Transition 9 status: te_complete - cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: - cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + cibmon[7446]: 2007/09/19_19:46:18 info: log_data_element: cib_update: + stonithd[10011]: 2007/09/19_19:46:51 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10011]: 2007/09/19_19:46:51 info: 10.0.0.166 has sysName 'RackPDU Archivage' stonithd[10155]: 2007/09/19_19:47:41 info: 10.0.0.166 uses sysOID '.1.3.6.1.4.1.318.1.3.4.5', compatible with 'masterSwitchrPDU' stonithd[10155]: 2007/09/19_19:47:41 info: 10.0.0.166 has sysName 'RackPDU Archivage'